[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260201 21:07:25.445201 4597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.125.126:38163
I20260201 21:07:25.445441 4597 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260201 21:07:25.445559 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:25.448648 4603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.448697 4602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.448858 4597 server_base.cc:1060] running on GCE node
W20260201 21:07:25.448891 4605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.449111 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:25.449177 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:25.449216 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980045449217 us; error 0 us; skew 500 ppm
I20260201 21:07:25.450096 4597 webserver.cc:492] Webserver started at http://127.4.125.126:39675/ using document root <none> and password file <none>
I20260201 21:07:25.450232 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:25.450273 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:25.450354 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:25.451190 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/master-0-root/instance:
uuid: "b456e86a62224980888bf3bb1e47bb8b"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.452147 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260201 21:07:25.452565 4610 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.452713 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.452770 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/master-0-root
uuid: "b456e86a62224980888bf3bb1e47bb8b"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.452808 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:25.479712 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:25.479909 4597 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260201 21:07:25.479985 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:25.480238 4616 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260201 21:07:25.483556 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.126:38163
I20260201 21:07:25.483615 4662 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.126:38163 every 8 connection(s)
I20260201 21:07:25.484055 4663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:25.486032 4663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: Bootstrap starting.
I20260201 21:07:25.486707 4663 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:25.486907 4663 log.cc:826] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: Log is configured to *not* fsync() on all Append() calls
I20260201 21:07:25.487344 4663 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: No bootstrap required, opened a new log
I20260201 21:07:25.488435 4663 raft_consensus.cc:359] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER }
I20260201 21:07:25.488519 4663 raft_consensus.cc:385] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:25.488549 4663 raft_consensus.cc:740] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b456e86a62224980888bf3bb1e47bb8b, State: Initialized, Role: FOLLOWER
I20260201 21:07:25.488639 4663 consensus_queue.cc:260] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER }
I20260201 21:07:25.488688 4663 raft_consensus.cc:399] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:07:25.488718 4663 raft_consensus.cc:493] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:07:25.488765 4663 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:25.489286 4663 raft_consensus.cc:515] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER }
I20260201 21:07:25.489380 4663 leader_election.cc:304] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b456e86a62224980888bf3bb1e47bb8b; no voters:
I20260201 21:07:25.489517 4663 leader_election.cc:290] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 21:07:25.489558 4666 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:07:25.489676 4666 raft_consensus.cc:697] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 1 LEADER]: Becoming Leader. State: Replica: b456e86a62224980888bf3bb1e47bb8b, State: Running, Role: LEADER
I20260201 21:07:25.489717 4663 sys_catalog.cc:565] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [sys.catalog]: configured and running, proceeding with master startup.
I20260201 21:07:25.489789 4666 consensus_queue.cc:237] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER }
I20260201 21:07:25.490104 4667 sys_catalog.cc:455] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b456e86a62224980888bf3bb1e47bb8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER } }
I20260201 21:07:25.490130 4668 sys_catalog.cc:455] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b456e86a62224980888bf3bb1e47bb8b. Latest consensus state: current_term: 1 leader_uuid: "b456e86a62224980888bf3bb1e47bb8b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b456e86a62224980888bf3bb1e47bb8b" member_type: VOTER } }
I20260201 21:07:25.490234 4667 sys_catalog.cc:458] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [sys.catalog]: This master's current role is: LEADER
I20260201 21:07:25.490299 4668 sys_catalog.cc:458] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [sys.catalog]: This master's current role is: LEADER
I20260201 21:07:25.490554 4674 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 21:07:25.490985 4674 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 21:07:25.491142 4597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 21:07:25.492079 4674 catalog_manager.cc:1357] Generated new cluster ID: 852eaa5b1bb94c869313766be864f629
I20260201 21:07:25.492125 4674 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 21:07:25.508689 4674 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 21:07:25.509114 4674 catalog_manager.cc:1514] Loading token signing keys...
I20260201 21:07:25.518800 4674 catalog_manager.cc:6027] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: Generated new TSK 0
I20260201 21:07:25.518911 4674 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 21:07:25.522903 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:25.524086 4688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.524174 4685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.524190 4686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.524335 4597 server_base.cc:1060] running on GCE node
I20260201 21:07:25.524416 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:25.524449 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:25.524477 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980045524476 us; error 0 us; skew 500 ppm
I20260201 21:07:25.525004 4597 webserver.cc:492] Webserver started at http://127.4.125.65:37125/ using document root <none> and password file <none>
I20260201 21:07:25.525079 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:25.525118 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:25.525182 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:25.525413 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-0-root/instance:
uuid: "550b2d5cf3684c8095905699979b84f9"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.526338 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:07:25.526791 4693 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.526911 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.526955 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "550b2d5cf3684c8095905699979b84f9"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.526993 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:25.545437 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:25.545644 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:25.545804 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:25.546049 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:25.546087 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.546118 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:25.546141 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.550369 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:38395
I20260201 21:07:25.550390 4756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:38395 every 8 connection(s)
I20260201 21:07:25.550701 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:25.551873 4761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.551945 4764 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.552053 4762 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.552316 4597 server_base.cc:1060] running on GCE node
I20260201 21:07:25.552423 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:25.552451 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:25.552471 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980045552471 us; error 0 us; skew 500 ppm
I20260201 21:07:25.552903 4597 webserver.cc:492] Webserver started at http://127.4.125.66:44855/ using document root <none> and password file <none>
I20260201 21:07:25.552987 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:25.553028 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:25.553068 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:25.553313 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-1-root/instance:
uuid: "053bc98be2b84a0194c5606c4c8a3cba"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.554209 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:07:25.554805 4769 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.554945 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.554978 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-1-root
uuid: "053bc98be2b84a0194c5606c4c8a3cba"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.555009 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:25.555598 4757 heartbeater.cc:344] Connected to a master server at 127.4.125.126:38163
I20260201 21:07:25.555660 4757 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:25.555771 4757 heartbeater.cc:507] Master 127.4.125.126:38163 requested a full tablet report, sending...
I20260201 21:07:25.556108 4627 ts_manager.cc:194] Registered new tserver with Master: 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:25.556639 4627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59754
I20260201 21:07:25.581426 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:25.581573 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:25.581698 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:25.581871 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:25.581902 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.581931 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:25.581954 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.585671 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.66:37677
I20260201 21:07:25.585697 4832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.66:37677 every 8 connection(s)
I20260201 21:07:25.586050 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:25.587189 4836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:25.587393 4839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.587472 4597 server_base.cc:1060] running on GCE node
W20260201 21:07:25.587708 4837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:25.587881 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:25.587926 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:25.587944 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980045587943 us; error 0 us; skew 500 ppm
I20260201 21:07:25.588537 4597 webserver.cc:492] Webserver started at http://127.4.125.67:42155/ using document root <none> and password file <none>
I20260201 21:07:25.588651 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:25.588723 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:25.588783 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:25.589084 4833 heartbeater.cc:344] Connected to a master server at 127.4.125.126:38163
I20260201 21:07:25.589094 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-2-root/instance:
uuid: "735a2f068a414be8bd12bccb5a153190"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.589177 4833 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:25.589277 4833 heartbeater.cc:507] Master 127.4.125.126:38163 requested a full tablet report, sending...
I20260201 21:07:25.589459 4627 ts_manager.cc:194] Registered new tserver with Master: 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677)
I20260201 21:07:25.589780 4627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59762
I20260201 21:07:25.590273 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:25.590741 4844 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.590849 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.590898 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-2-root
uuid: "735a2f068a414be8bd12bccb5a153190"
format_stamp: "Formatted at 2026-02-01 21:07:25 on dist-test-slave-cnth"
I20260201 21:07:25.590936 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:25.606592 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:25.606841 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:25.606989 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:25.607164 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:25.607199 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.607230 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:25.607254 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:25.611521 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.67:40179
I20260201 21:07:25.611541 4907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.67:40179 every 8 connection(s)
I20260201 21:07:25.614298 4908 heartbeater.cc:344] Connected to a master server at 127.4.125.126:38163
I20260201 21:07:25.614365 4908 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:25.614454 4908 heartbeater.cc:507] Master 127.4.125.126:38163 requested a full tablet report, sending...
I20260201 21:07:25.614642 4627 ts_manager.cc:194] Registered new tserver with Master: 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:25.614925 4627 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59778
I20260201 21:07:25.615029 4597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003358488s
I20260201 21:07:25.628975 4627 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59812:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 21:07:25.629237 4627 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 21:07:25.634954 4872 tablet_service.cc:1505] Processing CreateTablet for tablet 0aedcd7c464c4a73a10810a3e92172b9 (DEFAULT_TABLE table=test-workload [id=758b04c606bd4691bcfcac1831adefa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:25.635093 4872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aedcd7c464c4a73a10810a3e92172b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:25.635794 4721 tablet_service.cc:1505] Processing CreateTablet for tablet 0aedcd7c464c4a73a10810a3e92172b9 (DEFAULT_TABLE table=test-workload [id=758b04c606bd4691bcfcac1831adefa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:25.635885 4721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aedcd7c464c4a73a10810a3e92172b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:25.636842 4929 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Bootstrap starting.
I20260201 21:07:25.637082 4930 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Bootstrap starting.
I20260201 21:07:25.637673 4929 tablet_bootstrap.cc:654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:25.637796 4930 tablet_bootstrap.cc:654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:25.638181 4797 tablet_service.cc:1505] Processing CreateTablet for tablet 0aedcd7c464c4a73a10810a3e92172b9 (DEFAULT_TABLE table=test-workload [id=758b04c606bd4691bcfcac1831adefa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:25.638283 4797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0aedcd7c464c4a73a10810a3e92172b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:25.638440 4930 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: No bootstrap required, opened a new log
I20260201 21:07:25.638495 4930 ts_tablet_manager.cc:1403] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:25.638738 4930 raft_consensus.cc:359] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.638824 4930 raft_consensus.cc:385] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:25.638849 4930 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Initialized, Role: FOLLOWER
I20260201 21:07:25.638923 4930 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.639096 4930 ts_tablet_manager.cc:1434] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260201 21:07:25.639161 4757 heartbeater.cc:499] Master 127.4.125.126:38163 was elected leader, sending a full tablet report...
I20260201 21:07:25.639431 4934 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Bootstrap starting.
I20260201 21:07:25.639879 4934 tablet_bootstrap.cc:654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:25.640429 4934 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: No bootstrap required, opened a new log
I20260201 21:07:25.640481 4934 ts_tablet_manager.cc:1403] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:25.640631 4934 raft_consensus.cc:359] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.640692 4934 raft_consensus.cc:385] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:25.640723 4934 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Initialized, Role: FOLLOWER
I20260201 21:07:25.640769 4934 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.640967 4934 ts_tablet_manager.cc:1434] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260201 21:07:25.640990 4833 heartbeater.cc:499] Master 127.4.125.126:38163 was elected leader, sending a full tablet report...
I20260201 21:07:25.641445 4929 tablet_bootstrap.cc:492] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: No bootstrap required, opened a new log
I20260201 21:07:25.641515 4929 ts_tablet_manager.cc:1403] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260201 21:07:25.641650 4929 raft_consensus.cc:359] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.641702 4929 raft_consensus.cc:385] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:25.641718 4929 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Initialized, Role: FOLLOWER
I20260201 21:07:25.641762 4929 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.641884 4929 ts_tablet_manager.cc:1434] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260201 21:07:25.641929 4936 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 21:07:25.641961 4908 heartbeater.cc:499] Master 127.4.125.126:38163 was elected leader, sending a full tablet report...
I20260201 21:07:25.642083 4936 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.642701 4936 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:25.644743 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190" is_pre_election: true
I20260201 21:07:25.644822 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 0.
I20260201 21:07:25.645020 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:25.645113 4936 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 21:07:25.645171 4936 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:25.645193 4936 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:25.645310 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9" is_pre_election: true
I20260201 21:07:25.645365 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 0.
I20260201 21:07:25.645844 4936 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.646061 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:25.646078 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:25.646121 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:25.646133 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:25.646704 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 1.
I20260201 21:07:25.646704 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 1.
I20260201 21:07:25.646854 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:25.646003 4936 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 1 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:25.647024 4939 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:07:25.647084 4939 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:25.647125 4939 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:25.647639 4627 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 0 to 1, leader changed from <none> to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 1 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:25.653515 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 1 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260201 21:07:25.653512 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 1 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 21:07:25.653715 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:07:25.653800 4936 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:07:25.674415 4597 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260201 21:07:26.076272 4933 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:26.076354 4933 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:26.076970 4933 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.077129 4933 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 2 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:26.079464 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.079519 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:26.079712 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:26.079794 4933 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260201 21:07:26.084069 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 1. Current term is 2. Ops: []
I20260201 21:07:26.084254 4947 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 1.40, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
W20260201 21:07:26.084337 4947 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260201 21:07:26.084367 4947 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260201 21:07:26.133570 4947 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 LEADER]: Stepping down as leader of term 1
I20260201 21:07:26.133626 4947 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:26.133678 4947 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 1.40, Last appended by leader: 40, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.133801 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:26.195243 4977 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:26.195309 4977 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:26.195923 4977 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.196094 4977 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 2 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.199266 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.199266 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 2 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.199406 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 2: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:26.199870 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 2.
I20260201 21:07:26.200013 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:26.200129 4977 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 21:07:26.200234 4977 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:26.200284 4977 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 1.40, Last appended by leader: 40, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.200757 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 1 to 2, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 2 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:26.207096 4933 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:26.207142 4933 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:26.207551 4933 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.207648 4933 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 3 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:26.207800 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.207855 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:26.207813 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 3 candidate_status { last_received { term: 1 index: 40 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:26.208316 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 3.
I20260201 21:07:26.208473 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:26.208557 4933 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 21:07:26.208657 4933 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:26.208709 4933 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 1.40, Last appended by leader: 40, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.283317 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 2. Current term is 3. Ops: []
I20260201 21:07:26.283536 4977 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260201 21:07:26.283618 4977 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 3.41 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 40
I20260201 21:07:26.285777 4626 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 2 to 3, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 3 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:26.287349 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 3 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 1 index: 40. Preceding OpId from leader: term: 3 index: 41. (index mismatch)
I20260201 21:07:26.287528 4933 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260201 21:07:26.289748 4981 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 21:07:26.289788 4981 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:26.289837 4981 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.41, Last appended by leader: 41, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.289902 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:26.327593 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 3 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 2 index: 41. Preceding OpId from leader: term: 3 index: 41. (term mismatch)
I20260201 21:07:26.327638 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 40
I20260201 21:07:26.327661 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 2.41
I20260201 21:07:26.327692 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:26.327831 4933 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260201 21:07:26.388360 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 3 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:26.388423 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:26.388945 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.389065 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 4 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.389219 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.389230 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 4 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:26.389442 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:26.389523 4947 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 21:07:26.411089 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 3. Current term is 4. Ops: []
I20260201 21:07:26.411290 4986 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 3.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260201 21:07:26.493364 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 3. Current term is 4. Ops: []
I20260201 21:07:26.493559 4984 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 3.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260201 21:07:26.504742 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:26.504788 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 4 FOLLOWER]: Advancing to term 5
I20260201 21:07:26.505358 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.505481 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 5 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.505637 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:26.505633 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 5 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.505872 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:26.505975 4947 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260201 21:07:26.513564 4933 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 21:07:26.513608 4933 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:26.513674 4933 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 3.41, Last appended by leader: 41, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.513736 4933 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:26.549410 4981 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:26.549465 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:26.549978 4981 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.550096 4981 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 4 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.550247 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 4 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.550263 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 4 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.550323 4807 raft_consensus.cc:2368] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for earlier term 4. Current term is 5.
I20260201 21:07:26.550472 4846 leader_election.cc:400] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 4 election: Vote denied by peer 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for earlier term 4. Current term is 5.
I20260201 21:07:26.550509 4846 leader_election.cc:403] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 21:07:26.550614 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 4 FOLLOWER]: Advancing to term 5
I20260201 21:07:26.550868 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 4.
I20260201 21:07:26.551102 4981 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for earlier term 4. Current term is 5.
I20260201 21:07:26.620828 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:26.620883 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 5 FOLLOWER]: Advancing to term 6
I20260201 21:07:26.621351 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.621456 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 6 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.621614 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.621662 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 4 FOLLOWER]: Advancing to term 6
I20260201 21:07:26.621618 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 6 candidate_status { last_received { term: 3 index: 41 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:26.621699 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 5 FOLLOWER]: Advancing to term 6
I20260201 21:07:26.622090 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 6.
I20260201 21:07:26.622272 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters:
I20260201 21:07:26.622279 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 6.
I20260201 21:07:26.622380 4947 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 FOLLOWER]: Leader election won for term 6
I20260201 21:07:26.622490 4947 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:26.622542 4947 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 3.41, Last appended by leader: 41, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.622917 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 3 to 6, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 6 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:26.709348 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 6 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 41. Preceding OpId from leader: term: 6 index: 42. (index mismatch)
I20260201 21:07:26.709575 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260201 21:07:26.714166 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 6 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 3 index: 41. Preceding OpId from leader: term: 6 index: 42. (index mismatch)
I20260201 21:07:26.714336 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260201 21:07:26.810869 4981 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:26.810957 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 6 FOLLOWER]: Advancing to term 7
I20260201 21:07:26.811582 4981 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.811721 4981 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 7 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.811918 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.811945 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.812204 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:26.812316 4981 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260201 21:07:26.815485 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 6. Current term is 7. Ops: []
I20260201 21:07:26.815676 4988 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 6.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260201 21:07:26.913837 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 6. Current term is 7. Ops: []
I20260201 21:07:26.914033 4988 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 6.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260201 21:07:26.926827 4947 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 LEADER]: Stepping down as leader of term 6
I20260201 21:07:26.926882 4947 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:26.926949 4947 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 6.42, Last appended by leader: 42, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.927026 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 6 FOLLOWER]: Advancing to term 7
I20260201 21:07:26.959725 4981 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:26.959792 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:26.960383 4981 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.960538 4981 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 8 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:26.960728 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 8 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:26.960759 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 8 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:26.960808 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:26.961378 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 8.
I20260201 21:07:26.961521 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:26.961603 4981 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 FOLLOWER]: Leader election won for term 8
I20260201 21:07:26.961711 4981 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:26.961756 4981 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 6.42, Last appended by leader: 42, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:26.962160 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 6 to 8, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 8 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:27.005241 4986 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:27.005297 4986 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 6 FOLLOWER]: Advancing to term 7
I20260201 21:07:27.005812 4986 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.005939 4986 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 7 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:27.006078 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:27.006150 4807 raft_consensus.cc:2368] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 7. Current term is 8.
I20260201 21:07:27.006093 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.006269 4695 leader_election.cc:400] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 7 election: Vote denied by peer 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 7. Current term is 8.
I20260201 21:07:27.006309 4695 leader_election.cc:403] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260201 21:07:27.006371 4986 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:27.006819 4986 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 7. Current term is 8.
I20260201 21:07:27.045461 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 8 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 6 index: 42. Preceding OpId from leader: term: 8 index: 43. (index mismatch)
I20260201 21:07:27.045671 4981 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260201 21:07:27.061628 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 6 index: 42. Preceding OpId from leader: term: 8 index: 43. (index mismatch)
I20260201 21:07:27.061820 4981 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260201 21:07:27.261919 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:27.261996 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:27.262624 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.262769 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 9 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:27.262920 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.262920 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:27.263180 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:27.263265 4947 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260201 21:07:27.283262 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 8. Current term is 9. Ops: []
I20260201 21:07:27.283505 4990 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 8.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260201 21:07:27.326305 4986 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:27.326381 4986 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:27.327018 4986 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.327196 4986 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 9 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:27.327340 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:27.327370 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.327467 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 9: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:27.327610 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:27.327746 4986 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260201 21:07:27.329007 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 9 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 8. Current term is 9. Ops: []
I20260201 21:07:27.329245 4989 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 8.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260201 21:07:27.378702 4990 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 LEADER]: Stepping down as leader of term 8
I20260201 21:07:27.378791 4990 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:27.378842 4990 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 8.43, Last appended by leader: 43, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.378950 4990 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:27.406895 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:27.406958 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:07:27.407493 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.407630 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 10 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:27.407821 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.407822 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 10 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:27.407891 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:07:27.407915 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:07:27.408397 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 10.
I20260201 21:07:27.408504 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 10.
I20260201 21:07:27.408600 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:27.408685 4947 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 FOLLOWER]: Leader election won for term 10
I20260201 21:07:27.408747 4947 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:27.408804 4947 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 8.43, Last appended by leader: 43, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.409267 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 8 to 10, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 10 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:27.493461 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 10 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 43. Preceding OpId from leader: term: 10 index: 44. (index mismatch)
I20260201 21:07:27.493702 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260201 21:07:27.522413 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 10 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 8 index: 43. Preceding OpId from leader: term: 10 index: 44. (index mismatch)
I20260201 21:07:27.522600 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260201 21:07:27.623680 4991 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:27.623744 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:07:27.624356 4991 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.624496 4991 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 11 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:27.624645 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:27.624652 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.624859 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:27.624936 4991 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260201 21:07:27.626235 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.626664 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 10. Current term is 11. Ops: []
I20260201 21:07:27.626839 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 10.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260201 21:07:27.627449 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.629581 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.633713 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.641845 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.644996 4987 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 LEADER]: Stepping down as leader of term 10
I20260201 21:07:27.645048 4987 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:27.645110 4987 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.645210 4987 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:07:27.657980 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.687734 4990 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:27.687793 4990 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:07:27.688318 4990 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.688446 4990 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 11 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:27.688630 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:27.688657 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:27.688707 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 11: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:27.689287 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 11.
I20260201 21:07:27.689457 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:27.689539 4990 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 FOLLOWER]: Leader election won for term 11
I20260201 21:07:27.689601 4990 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:27.689652 4990 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.690034 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 10 to 11, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 11 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:27.690119 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.754300 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.771090 4991 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:27.771150 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 11 FOLLOWER]: Advancing to term 12
I20260201 21:07:27.771728 4991 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.771867 4991 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 12 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:27.772054 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.772053 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 12 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:27.772253 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 11 FOLLOWER]: Advancing to term 12
I20260201 21:07:27.772759 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 12.
I20260201 21:07:27.772945 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:27.773036 4991 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 FOLLOWER]: Leader election won for term 12
I20260201 21:07:27.773098 4991 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:27.773177 4991 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.773627 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 11 to 12, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 12 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:27.802290 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 12 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 11. Current term is 12. Ops: []
I20260201 21:07:27.802522 4990 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260201 21:07:27.802601 4990 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 LEADER]: Stepping down as leader of term 11
I20260201 21:07:27.802634 4990 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:27.802690 4990 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 11.45, Last appended by leader: 45, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.802757 4990 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 11 FOLLOWER]: Advancing to term 12
I20260201 21:07:27.853179 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 12 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 11 index: 45. Preceding OpId from leader: term: 12 index: 45. (term mismatch)
I20260201 21:07:27.853228 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 44
I20260201 21:07:27.853250 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 11.45
I20260201 21:07:27.853271 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:27.853503 4991 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260201 21:07:27.854349 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 12 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 10 index: 44. Preceding OpId from leader: term: 12 index: 45. (index mismatch)
I20260201 21:07:27.854669 4991 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260201 21:07:27.882472 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:27.955957 4947 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 12 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:27.956040 4947 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 12 FOLLOWER]: Advancing to term 13
I20260201 21:07:27.956658 4947 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.956804 4947 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 13 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:27.957000 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:27.957067 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 12 FOLLOWER]: Advancing to term 13
I20260201 21:07:27.957000 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:27.957643 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 13.
I20260201 21:07:27.957795 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:27.957865 4947 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 FOLLOWER]: Leader election won for term 13
I20260201 21:07:27.957885 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 13 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 12. Current term is 13. Ops: []
I20260201 21:07:27.957921 4947 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:27.958025 4947 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 12.45, Last appended by leader: 45, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.958074 4991 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 12.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260201 21:07:27.958176 4991 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 LEADER]: Stepping down as leader of term 12
I20260201 21:07:27.958209 4991 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:27.958267 4991 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 12.45, Last appended by leader: 45, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:27.958338 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 12 FOLLOWER]: Advancing to term 13
I20260201 21:07:27.958508 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 12 to 13, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 13 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:28.036796 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 13 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 45. Preceding OpId from leader: term: 13 index: 46. (index mismatch)
I20260201 21:07:28.037035 4947 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260201 21:07:28.037930 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 13 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 12 index: 45. Preceding OpId from leader: term: 13 index: 46. (index mismatch)
I20260201 21:07:28.038084 4987 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260201 21:07:28.138634 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:28.214993 4991 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:28.215078 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 13 FOLLOWER]: Advancing to term 14
I20260201 21:07:28.215677 4991 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.215803 4991 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 14 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:28.215993 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.216010 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 14 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:28.216205 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:28.216301 4991 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260201 21:07:28.220880 4990 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:28.220932 4990 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 13 FOLLOWER]: Advancing to term 14
I20260201 21:07:28.221468 4990 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.221573 4990 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 14 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:28.221743 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 14 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:28.221743 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 14 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.221865 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 14: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:28.222007 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:28.222090 4990 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260201 21:07:28.229290 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 14 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 13. Current term is 14. Ops: []
I20260201 21:07:28.229466 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 13.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260201 21:07:28.229542 4992 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 LEADER]: Stepping down as leader of term 13
I20260201 21:07:28.229558 4992 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:28.229621 4992 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 13.46, Last appended by leader: 46, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.229694 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 13 FOLLOWER]: Advancing to term 14
I20260201 21:07:28.337477 4990 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:28.337533 4990 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 14 FOLLOWER]: Advancing to term 15
I20260201 21:07:28.338016 4990 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.338126 4990 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 15 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:28.338289 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 15 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:28.338346 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 14 FOLLOWER]: Advancing to term 15
I20260201 21:07:28.338292 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 15 candidate_status { last_received { term: 13 index: 46 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.338382 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 14 FOLLOWER]: Advancing to term 15
I20260201 21:07:28.338873 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 15.
I20260201 21:07:28.338863 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 15.
I20260201 21:07:28.339076 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:28.339169 4990 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 FOLLOWER]: Leader election won for term 15
I20260201 21:07:28.339224 4990 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:28.339254 4990 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 13.46, Last appended by leader: 46, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.339672 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 13 to 15, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 15 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:28.439962 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 15 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 13 index: 46. Preceding OpId from leader: term: 15 index: 47. (index mismatch)
I20260201 21:07:28.440181 4990 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260201 21:07:28.441038 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 15 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 13 index: 46. Preceding OpId from leader: term: 15 index: 47. (index mismatch)
I20260201 21:07:28.441205 4990 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260201 21:07:28.542232 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 15 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:28.542294 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 15 FOLLOWER]: Advancing to term 16
I20260201 21:07:28.542838 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.542949 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 16 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:28.543114 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:28.543102 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 16 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:28.543334 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:28.543485 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 15. Current term is 16. Ops: []
I20260201 21:07:28.543565 4992 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260201 21:07:28.543673 4993 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 15.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260201 21:07:28.543879 4981 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 LEADER]: Stepping down as leader of term 15
I20260201 21:07:28.543913 4981 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:28.543969 4981 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 15.47, Last appended by leader: 47, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.544044 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 15 FOLLOWER]: Advancing to term 16
I20260201 21:07:28.632689 4991 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:28.632752 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 15 FOLLOWER]: Advancing to term 16
I20260201 21:07:28.633376 4991 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.633520 4991 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 16 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:28.633688 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.633692 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 16 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:28.633759 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 16: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:28.634281 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 16.
I20260201 21:07:28.634446 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:28.634527 4991 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 FOLLOWER]: Leader election won for term 16
I20260201 21:07:28.634614 4991 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:28.634653 4991 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 15.47, Last appended by leader: 47, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.635063 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 15 to 16, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 16 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:28.650812 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:28.680109 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:28.680181 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 16 FOLLOWER]: Advancing to term 17
I20260201 21:07:28.680759 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.680887 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 17 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:28.681048 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:28.681048 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 17 candidate_status { last_received { term: 15 index: 47 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:28.681174 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 16 FOLLOWER]: Advancing to term 17
I20260201 21:07:28.681699 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 17.
I20260201 21:07:28.681846 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:28.681924 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 FOLLOWER]: Leader election won for term 17
I20260201 21:07:28.681970 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:28.682005 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 15.47, Last appended by leader: 47, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.682390 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 16 to 17, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 17 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:28.717250 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 16. Current term is 17. Ops: []
I20260201 21:07:28.717451 4991 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260201 21:07:28.717525 4991 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 17.48 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 47
I20260201 21:07:28.717545 4991 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 LEADER]: Stepping down as leader of term 16
I20260201 21:07:28.717569 4991 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:28.717617 4991 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 16.48, Last appended by leader: 48, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.717669 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 16 FOLLOWER]: Advancing to term 17
I20260201 21:07:28.778910 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 17 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 15 index: 47. Preceding OpId from leader: term: 17 index: 48. (index mismatch)
I20260201 21:07:28.779147 4992 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260201 21:07:28.780292 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 17 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 16 index: 48. Preceding OpId from leader: term: 17 index: 48. (term mismatch)
I20260201 21:07:28.780345 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 47
I20260201 21:07:28.780364 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 16.48
I20260201 21:07:28.780390 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:28.780581 4995 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260201 21:07:28.881070 4981 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:28.881186 4981 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 17 FOLLOWER]: Advancing to term 18
I20260201 21:07:28.881764 4981 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.881906 4981 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 18 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:28.882091 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 18 candidate_status { last_received { term: 17 index: 48 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.882091 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 18 candidate_status { last_received { term: 17 index: 48 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:28.882211 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 17 FOLLOWER]: Advancing to term 18
I20260201 21:07:28.882776 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 18.
I20260201 21:07:28.882920 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:28.883018 4981 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 FOLLOWER]: Leader election won for term 18
I20260201 21:07:28.883067 4981 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:28.883117 4981 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 17.48, Last appended by leader: 48, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.883329 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 17. Current term is 18. Ops: []
I20260201 21:07:28.883507 4995 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 17.48, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260201 21:07:28.883586 4995 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 18.49 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 48
I20260201 21:07:28.883622 4992 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 LEADER]: Stepping down as leader of term 17
I20260201 21:07:28.883618 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 17 to 18, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 18 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:28.883697 4992 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:28.883775 4992 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 17.48, Last appended by leader: 48, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.883843 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 17 FOLLOWER]: Advancing to term 18
I20260201 21:07:28.983489 4991 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:28.983587 4991 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 18 FOLLOWER]: Advancing to term 19
I20260201 21:07:28.984177 4991 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.984323 4991 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 19 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:28.984509 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 48 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:28.984520 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 19 candidate_status { last_received { term: 17 index: 48 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:28.984598 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 18 FOLLOWER]: Advancing to term 19
I20260201 21:07:28.985203 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 19.
I20260201 21:07:28.985357 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:28.985438 4991 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 FOLLOWER]: Leader election won for term 19
I20260201 21:07:28.985500 4991 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:28.985549 4991 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 17.48, Last appended by leader: 48, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.985944 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 18 to 19, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 19 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:28.989758 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 18. Current term is 19. Ops: []
I20260201 21:07:28.989943 4981 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260201 21:07:28.990007 4981 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 19.49 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 48
I20260201 21:07:28.990044 4993 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 LEADER]: Stepping down as leader of term 18
I20260201 21:07:28.990085 4993 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:28.990127 4993 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 18.49, Last appended by leader: 49, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:28.990211 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 18 FOLLOWER]: Advancing to term 19
I20260201 21:07:29.074700 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 19 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 17 index: 48. Preceding OpId from leader: term: 19 index: 49. (index mismatch)
I20260201 21:07:29.074920 4991 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260201 21:07:29.075846 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 19 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 18 index: 49. Preceding OpId from leader: term: 19 index: 49. (term mismatch)
I20260201 21:07:29.075899 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 48
I20260201 21:07:29.075939 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 18.49
I20260201 21:07:29.075959 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:29.076140 4996 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260201 21:07:29.258842 4993 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:29.258919 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 19 FOLLOWER]: Advancing to term 20
I20260201 21:07:29.259552 4993 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.259707 4993 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 20 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:29.259934 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 20 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:29.259938 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 20 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:29.260193 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:29.260288 4993 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260201 21:07:29.268903 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 19. Current term is 20. Ops: []
I20260201 21:07:29.269097 4996 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 19.49, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260201 21:07:29.269205 4996 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 LEADER]: Stepping down as leader of term 19
I20260201 21:07:29.269240 4996 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:29.269322 4996 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 19.49, Last appended by leader: 49, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.269404 4996 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 19 FOLLOWER]: Advancing to term 20
I20260201 21:07:29.360699 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 19 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:29.360756 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 19 FOLLOWER]: Advancing to term 20
I20260201 21:07:29.361366 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.361483 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 20 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:29.361649 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:29.361658 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 20 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:29.361719 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 20: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:29.362222 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 20.
I20260201 21:07:29.362394 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:29.362473 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 FOLLOWER]: Leader election won for term 20
I20260201 21:07:29.362529 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:29.362582 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 19.49, Last appended by leader: 49, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.362985 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 19 to 20, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 20 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:29.394398 4993 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:29.394443 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 20 FOLLOWER]: Advancing to term 21
I20260201 21:07:29.394881 4993 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.394984 4993 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 21 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:29.395115 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 21 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:29.395118 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 21 candidate_status { last_received { term: 19 index: 49 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:29.395198 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 20 FOLLOWER]: Advancing to term 21
I20260201 21:07:29.395670 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 21.
I20260201 21:07:29.395814 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:29.395886 4993 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 FOLLOWER]: Leader election won for term 21
I20260201 21:07:29.395929 4993 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:29.395961 4993 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 19.49, Last appended by leader: 49, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.396365 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 20 to 21, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 21 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:29.463522 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 21 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 20. Current term is 21. Ops: []
I20260201 21:07:29.463764 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260201 21:07:29.463862 4992 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 LEADER]: Stepping down as leader of term 20
I20260201 21:07:29.463876 4992 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:29.463946 4992 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 20.50, Last appended by leader: 50, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.464004 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 20 FOLLOWER]: Advancing to term 21
I20260201 21:07:29.484611 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 21 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 19 index: 49. Preceding OpId from leader: term: 21 index: 50. (index mismatch)
I20260201 21:07:29.484825 4993 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260201 21:07:29.485677 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 21 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 20 index: 50. Preceding OpId from leader: term: 21 index: 50. (term mismatch)
I20260201 21:07:29.485729 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 49
I20260201 21:07:29.485749 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 20.50
I20260201 21:07:29.485771 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:29.485901 4997 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260201 21:07:29.651093 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:29.672390 4996 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:29.672463 4996 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 21 FOLLOWER]: Advancing to term 22
I20260201 21:07:29.673069 4996 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.673251 4996 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 22 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:29.673401 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:29.673439 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:29.673630 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:29.673738 4996 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260201 21:07:29.682956 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 21. Current term is 22. Ops: []
I20260201 21:07:29.683192 4993 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 21.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260201 21:07:29.683296 4993 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 LEADER]: Stepping down as leader of term 21
I20260201 21:07:29.683334 4993 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:29.683404 4993 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.683475 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 21 FOLLOWER]: Advancing to term 22
I20260201 21:07:29.766629 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 21 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:29.766728 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 21 FOLLOWER]: Advancing to term 22
I20260201 21:07:29.767346 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.767513 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 22 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:29.767695 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:29.767705 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 22 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:29.767763 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 22: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:29.768352 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 22.
I20260201 21:07:29.768520 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:29.768606 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 FOLLOWER]: Leader election won for term 22
I20260201 21:07:29.768658 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:29.768715 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.769177 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 21 to 22, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 22 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:29.821254 4996 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:29.821343 4996 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 22 FOLLOWER]: Advancing to term 23
I20260201 21:07:29.821911 4996 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.822034 4996 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 23 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:29.822237 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:29.822233 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 23 candidate_status { last_received { term: 21 index: 50 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:29.822338 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 22 FOLLOWER]: Advancing to term 23
I20260201 21:07:29.822831 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 23.
I20260201 21:07:29.822989 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:29.823062 4996 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 FOLLOWER]: Leader election won for term 23
I20260201 21:07:29.823166 4996 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:29.823221 4996 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.50, Last appended by leader: 50, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.823786 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 22 to 23, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 23 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:29.847437 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 22. Current term is 23. Ops: []
I20260201 21:07:29.847643 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260201 21:07:29.847723 4992 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 23.51 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 50
I20260201 21:07:29.847752 4995 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 LEADER]: Stepping down as leader of term 22
I20260201 21:07:29.847790 4995 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:29.847846 4995 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 22.51, Last appended by leader: 51, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:29.847947 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 22 FOLLOWER]: Advancing to term 23
I20260201 21:07:29.911412 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 23 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 22 index: 51. Preceding OpId from leader: term: 23 index: 51. (term mismatch)
I20260201 21:07:29.911490 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 50
I20260201 21:07:29.911512 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 22.51
I20260201 21:07:29.911530 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:29.911760 4996 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260201 21:07:29.912806 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 23 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 21 index: 50. Preceding OpId from leader: term: 23 index: 51. (index mismatch)
I20260201 21:07:29.913066 4999 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260201 21:07:30.014458 4993 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:30.014556 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 23 FOLLOWER]: Advancing to term 24
I20260201 21:07:30.015275 4993 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.015393 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 23. Current term is 24. Ops: []
I20260201 21:07:30.015440 4993 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 24 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:30.015560 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 24 candidate_status { last_received { term: 23 index: 51 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:30.015588 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 24 candidate_status { last_received { term: 23 index: 51 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:30.015618 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 23 FOLLOWER]: Advancing to term 24
I20260201 21:07:30.015625 4998 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 23.51, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260201 21:07:30.015714 4998 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 LEADER]: Stepping down as leader of term 23
I20260201 21:07:30.015738 4998 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:30.015772 4998 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 23.51, Last appended by leader: 51, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.015825 4998 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 23 FOLLOWER]: Advancing to term 24
I20260201 21:07:30.016292 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 24.
I20260201 21:07:30.016463 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:30.016551 4993 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 FOLLOWER]: Leader election won for term 24
I20260201 21:07:30.016608 4993 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:30.016652 4993 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 23.51, Last appended by leader: 51, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.016983 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 23 to 24, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 24 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:30.106391 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 24 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 23 index: 51. Preceding OpId from leader: term: 24 index: 52. (index mismatch)
I20260201 21:07:30.106616 4993 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260201 21:07:30.107594 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 24 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 23 index: 51. Preceding OpId from leader: term: 24 index: 52. (index mismatch)
I20260201 21:07:30.107806 5000 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260201 21:07:30.207811 4995 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 24 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:30.207901 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 24 FOLLOWER]: Advancing to term 25
I20260201 21:07:30.208614 4995 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.208833 4995 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 25 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:30.209041 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 52 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:30.209041 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 25 candidate_status { last_received { term: 24 index: 52 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:30.209180 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 24 FOLLOWER]: Advancing to term 25
I20260201 21:07:30.209724 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 25.
I20260201 21:07:30.209880 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:30.209962 4995 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 FOLLOWER]: Leader election won for term 25
I20260201 21:07:30.210014 4995 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:30.210081 4995 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 24.52, Last appended by leader: 52, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.210531 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 24 to 25, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 25 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:30.212604 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 25 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 24. Current term is 25. Ops: []
I20260201 21:07:30.212863 4997 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 24.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260201 21:07:30.212960 4997 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 LEADER]: Stepping down as leader of term 24
I20260201 21:07:30.212993 4997 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:30.213052 4997 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 24.52, Last appended by leader: 52, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.213124 4997 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 24 FOLLOWER]: Advancing to term 25
I20260201 21:07:30.286990 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 25 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 52. Preceding OpId from leader: term: 25 index: 53. (index mismatch)
I20260201 21:07:30.287256 4995 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260201 21:07:30.288130 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 25 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 24 index: 52. Preceding OpId from leader: term: 25 index: 53. (index mismatch)
I20260201 21:07:30.288353 5001 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260201 21:07:30.571997 4998 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:30.572085 4998 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 25 FOLLOWER]: Advancing to term 26
I20260201 21:07:30.572729 4998 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.572871 4998 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 26 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:30.573037 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:30.573052 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:30.573256 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:30.573339 4998 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260201 21:07:30.585055 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 25. Current term is 26. Ops: []
I20260201 21:07:30.585283 4995 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 25.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260201 21:07:30.585386 4995 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 LEADER]: Stepping down as leader of term 25
I20260201 21:07:30.585425 4995 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:30.585496 4995 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.585569 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 25 FOLLOWER]: Advancing to term 26
I20260201 21:07:30.651336 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:30.658776 4997 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:30.658869 4997 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 25 FOLLOWER]: Advancing to term 26
I20260201 21:07:30.659492 4997 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.659647 4997 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 26 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:30.659853 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:30.659889 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:30.659996 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 26: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:30.660408 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 26.
I20260201 21:07:30.660578 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:30.660696 4997 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 FOLLOWER]: Leader election won for term 26
I20260201 21:07:30.660748 4997 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:30.660796 4997 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.661250 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 25 to 26, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 26 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:30.693823 4998 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:30.693920 4998 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 26 FOLLOWER]: Advancing to term 27
I20260201 21:07:30.694578 4998 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.694731 4998 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 27 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:30.694919 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 27 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:30.694926 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 27 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:30.695013 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 26 FOLLOWER]: Advancing to term 27
I20260201 21:07:30.695537 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 27.
I20260201 21:07:30.695684 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:30.695765 4998 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 FOLLOWER]: Leader election won for term 27
I20260201 21:07:30.695861 4998 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:30.695902 4998 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.696326 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 26 to 27, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 27 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:30.764938 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 26. Current term is 27. Ops: []
I20260201 21:07:30.765209 4997 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260201 21:07:30.765316 4997 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 27.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260201 21:07:30.765344 4993 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 LEADER]: Stepping down as leader of term 26
I20260201 21:07:30.765390 4993 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:30.765453 4993 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 26.54, Last appended by leader: 54, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.765532 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 26 FOLLOWER]: Advancing to term 27
I20260201 21:07:30.782879 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 27 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 27 index: 54. (term mismatch)
I20260201 21:07:30.782929 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 53
I20260201 21:07:30.782953 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 26.54
I20260201 21:07:30.782969 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:30.783157 4998 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260201 21:07:30.784036 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 27 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 25 index: 53. Preceding OpId from leader: term: 27 index: 54. (index mismatch)
I20260201 21:07:30.784274 5002 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260201 21:07:30.885484 4995 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 27 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:30.885545 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 27 FOLLOWER]: Advancing to term 28
I20260201 21:07:30.886119 4995 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.886281 4995 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 28 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:30.886418 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:30.886421 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:30.886657 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:30.886731 4995 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260201 21:07:30.888731 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 27. Current term is 28. Ops: []
I20260201 21:07:30.888931 5003 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 27.54, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260201 21:07:30.889031 5003 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 LEADER]: Stepping down as leader of term 27
I20260201 21:07:30.889066 5003 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:30.889122 5003 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.54, Last appended by leader: 54, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.889235 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 27 FOLLOWER]: Advancing to term 28
I20260201 21:07:30.991477 4993 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:30.991555 4993 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 27 FOLLOWER]: Advancing to term 28
I20260201 21:07:30.992131 4993 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.992270 4993 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 28 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:30.992420 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:30.992482 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 28: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:30.992463 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 28 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:30.993052 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 28.
I20260201 21:07:30.993249 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:30.993342 4993 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 FOLLOWER]: Leader election won for term 28
I20260201 21:07:30.993399 4993 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:30.993460 4993 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.54, Last appended by leader: 54, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:30.993836 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 27 to 28, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 28 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:31.032298 4995 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:31.032352 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 28 FOLLOWER]: Advancing to term 29
I20260201 21:07:31.032850 4995 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.032958 4995 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 29 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:31.033079 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:31.033079 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 29 candidate_status { last_received { term: 27 index: 54 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:31.033228 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 28 FOLLOWER]: Advancing to term 29
I20260201 21:07:31.033659 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 29.
I20260201 21:07:31.033811 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:31.033905 4995 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 FOLLOWER]: Leader election won for term 29
I20260201 21:07:31.033955 4995 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:31.033990 4995 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.54, Last appended by leader: 54, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.034384 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 28 to 29, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 29 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:31.088141 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 28. Current term is 29. Ops: []
I20260201 21:07:31.088410 4993 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260201 21:07:31.088490 4993 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 29.55 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 54
I20260201 21:07:31.088531 4997 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 LEADER]: Stepping down as leader of term 28
I20260201 21:07:31.088572 4997 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:31.088624 4997 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 28.55, Last appended by leader: 55, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.088696 4997 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 28 FOLLOWER]: Advancing to term 29
I20260201 21:07:31.113623 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 29 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 29 index: 55. (term mismatch)
I20260201 21:07:31.113665 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 54
I20260201 21:07:31.113677 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 28.55
I20260201 21:07:31.113689 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:31.113824 4995 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260201 21:07:31.114566 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 29 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 27 index: 54. Preceding OpId from leader: term: 29 index: 55. (index mismatch)
I20260201 21:07:31.114712 4995 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260201 21:07:31.215834 5003 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:31.215917 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 29 FOLLOWER]: Advancing to term 30
I20260201 21:07:31.216552 5003 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.216800 5003 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 30 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:31.216871 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 30 candidate_status { last_received { term: 29 index: 55 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:31.216943 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 29 FOLLOWER]: Advancing to term 30
I20260201 21:07:31.216885 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 30 candidate_status { last_received { term: 29 index: 55 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:31.217537 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 30.
I20260201 21:07:31.217689 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:31.217767 5003 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 FOLLOWER]: Leader election won for term 30
I20260201 21:07:31.217811 5003 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:31.217850 5003 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 29.55, Last appended by leader: 55, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.218235 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 29 to 30, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 30 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:31.218381 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 30 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 29. Current term is 30. Ops: []
I20260201 21:07:31.218638 4995 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 29.55, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260201 21:07:31.218722 4995 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 LEADER]: Stepping down as leader of term 29
I20260201 21:07:31.218746 4995 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:31.218793 4995 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 29.55, Last appended by leader: 55, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.218849 4995 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 29 FOLLOWER]: Advancing to term 30
I20260201 21:07:31.316633 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 30 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 29 index: 55. Preceding OpId from leader: term: 30 index: 56. (index mismatch)
I20260201 21:07:31.316882 5003 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260201 21:07:31.317868 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 30 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 29 index: 55. Preceding OpId from leader: term: 30 index: 56. (index mismatch)
I20260201 21:07:31.318048 4998 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260201 21:07:31.418154 4997 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:31.418260 4997 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 30 FOLLOWER]: Advancing to term 31
I20260201 21:07:31.418916 4997 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.419057 4997 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 31 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:31.419195 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:31.419205 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:31.419447 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:31.419533 4997 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260201 21:07:31.425236 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 30. Current term is 31. Ops: []
I20260201 21:07:31.425444 5002 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 30.56, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260201 21:07:31.425530 5002 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 LEADER]: Stepping down as leader of term 30
I20260201 21:07:31.425559 5002 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:31.425622 5002 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.425693 5002 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 30 FOLLOWER]: Advancing to term 31
I20260201 21:07:31.519484 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 30 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:31.519563 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 30 FOLLOWER]: Advancing to term 31
I20260201 21:07:31.520190 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.520337 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 31 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:31.520540 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:31.520545 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:31.520649 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 31: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:31.521260 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 31.
I20260201 21:07:31.521420 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:31.521502 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 FOLLOWER]: Leader election won for term 31
I20260201 21:07:31.521548 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:31.521627 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.522035 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 30 to 31, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 31 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:31.557914 4997 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:31.557979 4997 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 31 FOLLOWER]: Advancing to term 32
I20260201 21:07:31.558528 4997 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.558661 4997 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 32 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:31.558840 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 32 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:31.558840 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 32 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:31.558949 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 31 FOLLOWER]: Advancing to term 32
I20260201 21:07:31.559466 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 32.
I20260201 21:07:31.559605 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:31.559736 4997 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 FOLLOWER]: Leader election won for term 32
I20260201 21:07:31.559800 4997 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:31.559855 4997 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.560276 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 31 to 32, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 32 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:31.617321 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 32 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 31. Current term is 32. Ops: []
I20260201 21:07:31.617555 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260201 21:07:31.617640 4992 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 LEADER]: Stepping down as leader of term 31
I20260201 21:07:31.617671 4992 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:31.617723 4992 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 31.57, Last appended by leader: 57, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.617789 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 31 FOLLOWER]: Advancing to term 32
I20260201 21:07:31.637418 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 32 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 31 index: 57. Preceding OpId from leader: term: 32 index: 57. (term mismatch)
I20260201 21:07:31.637461 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 56
I20260201 21:07:31.637482 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 31.57
I20260201 21:07:31.637502 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:31.637696 4997 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260201 21:07:31.638458 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 32 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 32 index: 57. (index mismatch)
I20260201 21:07:31.638671 5004 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260201 21:07:31.651549 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:31.739447 5002 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:31.739521 5002 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 32 FOLLOWER]: Advancing to term 33
I20260201 21:07:31.740108 5002 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.740247 5002 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 33 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:31.740449 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:31.740449 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:31.740554 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 32 FOLLOWER]: Advancing to term 33
I20260201 21:07:31.741091 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 33.
I20260201 21:07:31.741286 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:31.741390 5002 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 FOLLOWER]: Leader election won for term 33
I20260201 21:07:31.741451 5002 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:31.741503 5002 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.57, Last appended by leader: 57, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.741851 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 32 to 33, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 33 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:31.747035 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 32. Current term is 33. Ops: []
I20260201 21:07:31.747239 4997 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 32.57, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260201 21:07:31.747319 4997 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 33.58 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 57
I20260201 21:07:31.747344 5004 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 LEADER]: Stepping down as leader of term 32
I20260201 21:07:31.747391 5004 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:31.747462 5004 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.57, Last appended by leader: 57, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:31.747535 5004 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 32 FOLLOWER]: Advancing to term 33
I20260201 21:07:31.832398 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 33 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 32 index: 57. Preceding OpId from leader: term: 33 index: 58. (index mismatch)
I20260201 21:07:31.832612 5002 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260201 21:07:31.833421 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 33 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 32 index: 57. Preceding OpId from leader: term: 33 index: 58. (index mismatch)
I20260201 21:07:31.833608 4998 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260201 21:07:32.133460 5004 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:32.133540 5004 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 33 FOLLOWER]: Advancing to term 34
I20260201 21:07:32.134140 5004 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.134292 5004 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 34 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:32.134452 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:32.134456 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:32.134678 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:32.134768 5004 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260201 21:07:32.139566 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 33. Current term is 34. Ops: []
I20260201 21:07:32.139757 5003 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 33.58, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260201 21:07:32.139844 5003 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 LEADER]: Stepping down as leader of term 33
I20260201 21:07:32.139881 5003 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:32.139922 5003 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.139997 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 33 FOLLOWER]: Advancing to term 34
I20260201 21:07:32.221998 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 33 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:32.222066 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 33 FOLLOWER]: Advancing to term 34
I20260201 21:07:32.222630 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.222788 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 34 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:32.222965 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:32.222985 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:32.223063 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 34: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:32.223500 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 34.
I20260201 21:07:32.223662 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:32.223734 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 FOLLOWER]: Leader election won for term 34
I20260201 21:07:32.223829 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:32.223868 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.224280 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 33 to 34, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 34 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:32.275034 5004 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:32.275084 5004 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 34 FOLLOWER]: Advancing to term 35
I20260201 21:07:32.275557 5004 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.275673 5004 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 35 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:32.275828 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 35 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:32.275828 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 35 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:32.275925 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 34 FOLLOWER]: Advancing to term 35
I20260201 21:07:32.276362 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 35.
I20260201 21:07:32.276523 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:32.276597 5004 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 FOLLOWER]: Leader election won for term 35
I20260201 21:07:32.276683 5004 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:32.276718 5004 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.277058 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 34 to 35, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 35 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:32.301563 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 34. Current term is 35. Ops: []
I20260201 21:07:32.301749 4992 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260201 21:07:32.301819 4992 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 35.59 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 58
I20260201 21:07:32.301839 4992 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 LEADER]: Stepping down as leader of term 34
I20260201 21:07:32.301867 4992 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:32.301914 4992 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.59, Last appended by leader: 59, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.301970 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 34 FOLLOWER]: Advancing to term 35
I20260201 21:07:32.366415 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 35 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 34 index: 59. Preceding OpId from leader: term: 35 index: 59. (term mismatch)
I20260201 21:07:32.366463 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 58
I20260201 21:07:32.366477 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 34.59
I20260201 21:07:32.366488 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 35 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:32.366663 5004 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260201 21:07:32.367506 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 35 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 33 index: 58. Preceding OpId from leader: term: 35 index: 59. (index mismatch)
I20260201 21:07:32.367695 5007 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260201 21:07:32.551868 5003 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 35 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:32.551939 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 35 FOLLOWER]: Advancing to term 36
I20260201 21:07:32.552575 5003 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.552718 5003 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 36 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:32.552855 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 36 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:32.552887 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 36 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:32.553062 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:32.553174 5003 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260201 21:07:32.570611 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 35. Current term is 36. Ops: []
I20260201 21:07:32.570811 5004 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 35.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260201 21:07:32.570896 5004 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 LEADER]: Stepping down as leader of term 35
I20260201 21:07:32.570940 5004 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:32.570998 5004 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 35.59, Last appended by leader: 59, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.571065 5004 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 35 FOLLOWER]: Advancing to term 36
I20260201 21:07:32.651787 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:32.651855 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 35 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:32.651894 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 35 FOLLOWER]: Advancing to term 36
I20260201 21:07:32.652359 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.652475 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 36 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:32.652609 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 36 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:32.652621 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 36 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:32.652704 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 36: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:32.653119 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 36.
I20260201 21:07:32.653271 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:32.653420 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 FOLLOWER]: Leader election won for term 36
I20260201 21:07:32.653475 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:32.653514 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 35.59, Last appended by leader: 59, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.653852 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 35 to 36, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 36 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:32.664628 5003 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:32.664676 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 36 FOLLOWER]: Advancing to term 37
I20260201 21:07:32.665114 5003 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.665256 5003 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 37 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:32.665392 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 37 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:32.665395 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 37 candidate_status { last_received { term: 35 index: 59 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:32.665524 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 36 FOLLOWER]: Advancing to term 37
I20260201 21:07:32.665983 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 37.
I20260201 21:07:32.666110 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:32.666186 5003 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 FOLLOWER]: Leader election won for term 37
I20260201 21:07:32.666297 5003 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:32.666332 5003 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 35.59, Last appended by leader: 59, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.666661 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 36 to 37, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 37 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:32.741835 4807 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 LEADER]: Stepping down as leader of term 36
I20260201 21:07:32.741889 4807 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:32.741928 4807 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 36.60, Last appended by leader: 60, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.742012 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 36 FOLLOWER]: Advancing to term 37
I20260201 21:07:32.742528 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 37 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 36 index: 60. Preceding OpId from leader: term: 37 index: 60. (term mismatch)
I20260201 21:07:32.742563 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 59
I20260201 21:07:32.742574 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 36.60
I20260201 21:07:32.742600 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 37 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:32.742776 5003 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260201 21:07:32.743567 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 37 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 35 index: 59. Preceding OpId from leader: term: 37 index: 60. (index mismatch)
I20260201 21:07:32.743729 5003 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260201 21:07:32.968627 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 37 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:32.968709 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 37 FOLLOWER]: Advancing to term 38
I20260201 21:07:32.969377 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.969537 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 38 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:32.969671 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 38 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:32.969672 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 38 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:32.969944 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 38 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:32.970065 4992 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Leader election lost for term 38. Reason: could not achieve majority
I20260201 21:07:32.988549 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 37. Current term is 38. Ops: []
I20260201 21:07:32.988747 5008 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 37.60, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260201 21:07:32.988832 5008 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 LEADER]: Stepping down as leader of term 37
I20260201 21:07:32.988862 5008 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:32.988919 5008 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 37.60, Last appended by leader: 60, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:32.988983 5008 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 37 FOLLOWER]: Advancing to term 38
I20260201 21:07:33.022320 5004 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 37 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:33.022372 5004 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 37 FOLLOWER]: Advancing to term 38
I20260201 21:07:33.022841 5004 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.022962 5004 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 38 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.023105 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 38 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.023105 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 38 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.023216 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 38: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:33.023708 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 38.
I20260201 21:07:33.023857 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:33.023948 5004 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 FOLLOWER]: Leader election won for term 38
I20260201 21:07:33.024003 5004 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.024053 5004 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 37.60, Last appended by leader: 60, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.024418 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 37 to 38, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 38 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:33.091383 4992 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:33.091444 4992 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 38 FOLLOWER]: Advancing to term 39
I20260201 21:07:33.091980 4992 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.092097 4992 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 39 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.092248 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 39 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.092257 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 39 candidate_status { last_received { term: 37 index: 60 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.092303 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 38 FOLLOWER]: Advancing to term 39
I20260201 21:07:33.092814 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 39.
I20260201 21:07:33.092993 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:33.093087 4992 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 FOLLOWER]: Leader election won for term 39
I20260201 21:07:33.093175 4992 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:33.093256 4992 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 37.60, Last appended by leader: 60, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.093698 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 38 to 39, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 39 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:33.137054 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 38. Current term is 39. Ops: []
I20260201 21:07:33.137270 5004 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260201 21:07:33.137349 5004 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 39.61 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 60
I20260201 21:07:33.137389 5007 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 LEADER]: Stepping down as leader of term 38
I20260201 21:07:33.137434 5007 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.137506 5007 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.61, Last appended by leader: 61, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.137583 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 38 FOLLOWER]: Advancing to term 39
I20260201 21:07:33.168884 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 39 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 37 index: 60. Preceding OpId from leader: term: 39 index: 61. (index mismatch)
I20260201 21:07:33.169111 4992 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260201 21:07:33.169996 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 39 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 38 index: 61. Preceding OpId from leader: term: 39 index: 61. (term mismatch)
I20260201 21:07:33.170051 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 60
I20260201 21:07:33.170073 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 38.61
I20260201 21:07:33.170099 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 39 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:33.170290 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260201 21:07:33.347157 5008 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 39 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:33.347258 5008 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 39 FOLLOWER]: Advancing to term 40
I20260201 21:07:33.347879 5008 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.348016 5008 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 40 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:33.348191 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 40 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.348191 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 40 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.348431 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 40 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:33.348521 5008 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Leader election lost for term 40. Reason: could not achieve majority
I20260201 21:07:33.361045 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 39. Current term is 40. Ops: []
I20260201 21:07:33.361321 5009 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 39.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260201 21:07:33.361423 5009 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 LEADER]: Stepping down as leader of term 39
I20260201 21:07:33.361469 5009 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:33.361528 5009 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 39.61, Last appended by leader: 61, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.361603 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 39 FOLLOWER]: Advancing to term 40
I20260201 21:07:33.395130 5007 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 39 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:33.395176 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 39 FOLLOWER]: Advancing to term 40
I20260201 21:07:33.395726 5007 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.395840 5007 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 40 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.395982 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 40 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.396009 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 40 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.396072 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 40: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:33.396538 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 40.
I20260201 21:07:33.396687 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:33.396767 5007 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 FOLLOWER]: Leader election won for term 40
I20260201 21:07:33.396834 5007 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.396885 5007 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 39.61, Last appended by leader: 61, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.397261 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 39 to 40, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 40 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:33.475630 5008 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:33.475692 5008 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 40 FOLLOWER]: Advancing to term 41
I20260201 21:07:33.476186 5008 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.476343 5008 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 41 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:33.476498 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 41 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.476511 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 41 candidate_status { last_received { term: 39 index: 61 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.476578 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 40 FOLLOWER]: Advancing to term 41
I20260201 21:07:33.477035 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 41.
I20260201 21:07:33.477205 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 41 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:33.477283 5008 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 FOLLOWER]: Leader election won for term 41
I20260201 21:07:33.477332 5008 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:33.477366 5008 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 39.61, Last appended by leader: 61, Current term: 41, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.477761 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 40 to 41, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 41 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:33.505688 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 41 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 40. Current term is 41. Ops: []
I20260201 21:07:33.505740 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 40. Current term is 41. Ops: []
I20260201 21:07:33.505896 5007 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260201 21:07:33.506037 5007 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 41.62 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 61
I20260201 21:07:33.506089 5004 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260201 21:07:33.506093 5010 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 LEADER]: Stepping down as leader of term 40
I20260201 21:07:33.506161 5010 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.506234 5010 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.62, Last appended by leader: 62, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.506311 5010 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 40 FOLLOWER]: Advancing to term 41
I20260201 21:07:33.572387 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 41 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 39 index: 61. Preceding OpId from leader: term: 41 index: 62. (index mismatch)
I20260201 21:07:33.572607 5008 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260201 21:07:33.573523 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 41 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 40 index: 62. Preceding OpId from leader: term: 41 index: 62. (term mismatch)
I20260201 21:07:33.573570 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 61
I20260201 21:07:33.573589 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 40.62
I20260201 21:07:33.573619 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 41 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:33.573752 5011 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260201 21:07:33.651978 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:33.674573 5009 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 41 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:33.674631 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 41 FOLLOWER]: Advancing to term 42
I20260201 21:07:33.675225 5009 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.675362 5009 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 42 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.675539 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.675539 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.675765 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:33.675846 5009 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20260201 21:07:33.680807 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 41. Current term is 42. Ops: []
I20260201 21:07:33.681030 5003 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 41.62, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260201 21:07:33.681128 5003 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 LEADER]: Stepping down as leader of term 41
I20260201 21:07:33.681178 5003 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:33.681231 5003 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 41, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.681293 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 41 FOLLOWER]: Advancing to term 42
I20260201 21:07:33.750734 5007 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 41 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:33.750793 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 41 FOLLOWER]: Advancing to term 42
I20260201 21:07:33.751392 5007 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.751533 5007 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 42 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.751709 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.751693 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.751791 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 42: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:33.752316 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 42.
I20260201 21:07:33.752468 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:33.752552 5007 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 FOLLOWER]: Leader election won for term 42
I20260201 21:07:33.752606 5007 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.752655 5007 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.753046 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 41 to 42, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 42 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:33.797273 5009 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:33.797329 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 42 FOLLOWER]: Advancing to term 43
I20260201 21:07:33.797799 5009 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.797909 5009 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 43 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:33.798032 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 43 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:33.798077 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 42 FOLLOWER]: Advancing to term 43
I20260201 21:07:33.798048 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 43 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.798496 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 43.
I20260201 21:07:33.798638 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:33.798714 5009 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 FOLLOWER]: Leader election won for term 43
I20260201 21:07:33.798756 5009 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:33.798784 5009 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.799141 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 42 to 43, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 43 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:33.830293 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 43 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 42. Current term is 43. Ops: []
I20260201 21:07:33.830519 5007 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260201 21:07:33.830595 5007 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 LEADER]: Stepping down as leader of term 42
I20260201 21:07:33.830610 5007 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:33.830664 5007 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 42.63, Last appended by leader: 63, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.830731 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 42 FOLLOWER]: Advancing to term 43
I20260201 21:07:33.885442 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 43 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 42 index: 63. Preceding OpId from leader: term: 43 index: 63. (term mismatch)
I20260201 21:07:33.885483 4882 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 62
I20260201 21:07:33.885505 4882 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 42.63
I20260201 21:07:33.885522 4882 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 43 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:33.885701 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260201 21:07:33.886440 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 43 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 41 index: 62. Preceding OpId from leader: term: 43 index: 63. (index mismatch)
I20260201 21:07:33.886623 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260201 21:07:33.987071 5003 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 43 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:33.987138 5003 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 43 FOLLOWER]: Advancing to term 44
I20260201 21:07:33.987673 5003 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.987788 5003 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 44 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:33.987960 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:33.987960 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:33.988051 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 43 FOLLOWER]: Advancing to term 44
I20260201 21:07:33.988569 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 44.
I20260201 21:07:33.988735 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:33.988832 5003 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 FOLLOWER]: Leader election won for term 44
I20260201 21:07:33.988879 5003 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:33.988929 5003 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:33.989334 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 43 to 44, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 44 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:34.000456 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 44 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 43. Current term is 44. Ops: []
I20260201 21:07:34.000667 5009 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 43.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260201 21:07:34.000751 5009 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 LEADER]: Stepping down as leader of term 43
I20260201 21:07:34.000780 5009 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:34.000838 5009 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.000913 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 43 FOLLOWER]: Advancing to term 44
I20260201 21:07:34.072813 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 44 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 44 index: 64. (index mismatch)
I20260201 21:07:34.072989 5003 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260201 21:07:34.073855 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 44 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 44 index: 64. (index mismatch)
I20260201 21:07:34.074077 5011 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260201 21:07:34.175028 5007 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 44 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:34.175107 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 44 FOLLOWER]: Advancing to term 45
I20260201 21:07:34.175699 5007 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.175899 5007 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 45 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:34.175992 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 45 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:34.176060 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 45 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:34.176261 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:34.176360 5007 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20260201 21:07:34.192978 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 44. Current term is 45. Ops: []
I20260201 21:07:34.193224 5011 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 44.64, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260201 21:07:34.193338 5011 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 LEADER]: Stepping down as leader of term 44
I20260201 21:07:34.193372 5011 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:34.193426 5011 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 44.64, Last appended by leader: 64, Current term: 44, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.193500 5011 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 44 FOLLOWER]: Advancing to term 45
I20260201 21:07:34.273138 5009 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 44 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:34.273212 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 44 FOLLOWER]: Advancing to term 45
I20260201 21:07:34.273780 5009 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.273912 5009 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 45 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:34.274094 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 45 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:34.274165 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 45: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:34.274108 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 45 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:34.274716 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 45.
I20260201 21:07:34.274865 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:34.274936 5009 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 FOLLOWER]: Leader election won for term 45
I20260201 21:07:34.274981 5009 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:34.275025 5009 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 44.64, Last appended by leader: 64, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.275403 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 44 to 45, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 45 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:34.319989 5007 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:34.320050 5007 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 45 FOLLOWER]: Advancing to term 46
I20260201 21:07:34.320576 5007 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.320701 5007 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 46 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:34.320859 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 46 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:34.320860 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 46 candidate_status { last_received { term: 44 index: 64 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:34.320931 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 45 FOLLOWER]: Advancing to term 46
I20260201 21:07:34.321457 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 46.
I20260201 21:07:34.321646 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:34.321722 5007 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 FOLLOWER]: Leader election won for term 46
I20260201 21:07:34.321777 5007 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:34.321820 5007 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 44.64, Last appended by leader: 64, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.322208 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 45 to 46, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 46 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:34.351637 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 46 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 45. Current term is 46. Ops: []
I20260201 21:07:34.351835 5009 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260201 21:07:34.351905 5009 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 LEADER]: Stepping down as leader of term 45
I20260201 21:07:34.351934 5009 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:34.351979 5009 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.65, Last appended by leader: 65, Current term: 45, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.352033 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 45 FOLLOWER]: Advancing to term 46
I20260201 21:07:34.444806 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 46 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 44 index: 64. Preceding OpId from leader: term: 46 index: 65. (index mismatch)
I20260201 21:07:34.445055 5007 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260201 21:07:34.446070 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 46 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 45 index: 65. Preceding OpId from leader: term: 46 index: 65. (term mismatch)
I20260201 21:07:34.446135 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 64
I20260201 21:07:34.446156 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 45.65
I20260201 21:07:34.446203 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 46 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:34.446353 5010 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260201 21:07:34.644981 5005 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 46 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:34.645083 5005 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 46 FOLLOWER]: Advancing to term 47
I20260201 21:07:34.645797 5005 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.645916 5005 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 47 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:34.646075 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 47 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:34.646073 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 47 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:34.646286 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 47 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:34.646370 5005 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Leader election lost for term 47. Reason: could not achieve majority
I20260201 21:07:34.652249 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:34.668675 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 46. Current term is 47. Ops: []
I20260201 21:07:34.668861 5012 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 46.65, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260201 21:07:34.668958 5012 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 LEADER]: Stepping down as leader of term 46
I20260201 21:07:34.668989 5012 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:34.669044 5012 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 46.65, Last appended by leader: 65, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.669113 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 46 FOLLOWER]: Advancing to term 47
I20260201 21:07:34.735111 5011 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 46 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:34.735163 5011 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 46 FOLLOWER]: Advancing to term 47
I20260201 21:07:34.735684 5011 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.735807 5011 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 47 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:34.735942 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 47 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:34.735950 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 47 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:34.736008 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 47: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:34.736488 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 47.
I20260201 21:07:34.736636 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:34.736708 5011 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 FOLLOWER]: Leader election won for term 47
I20260201 21:07:34.736796 5011 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:34.736832 5011 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 46.65, Last appended by leader: 65, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.737252 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 46 to 47, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 47 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:34.769985 5005 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:34.770052 5005 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 47 FOLLOWER]: Advancing to term 48
I20260201 21:07:34.770531 5005 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.770633 5005 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 48 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:34.770859 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 48 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:34.770859 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 48 candidate_status { last_received { term: 46 index: 65 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:34.770961 4882 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 47 FOLLOWER]: Advancing to term 48
I20260201 21:07:34.771453 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 48.
I20260201 21:07:34.771588 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:34.771672 5005 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 FOLLOWER]: Leader election won for term 48
I20260201 21:07:34.771713 5005 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:34.771741 5005 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 46.65, Last appended by leader: 65, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.772081 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 47 to 48, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 48 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:34.827584 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 47. Current term is 48. Ops: []
I20260201 21:07:34.827767 5011 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260201 21:07:34.827836 5011 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 48.66 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 65
I20260201 21:07:34.827874 5013 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 LEADER]: Stepping down as leader of term 47
I20260201 21:07:34.827906 5013 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:34.827955 5013 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.66, Last appended by leader: 66, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:34.828018 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 47 FOLLOWER]: Advancing to term 48
I20260201 21:07:34.874390 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 48 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 46 index: 65. Preceding OpId from leader: term: 48 index: 66. (index mismatch)
I20260201 21:07:34.874577 5005 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260201 21:07:34.875378 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 48 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 47 index: 66. Preceding OpId from leader: term: 48 index: 66. (term mismatch)
I20260201 21:07:34.875422 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 65
I20260201 21:07:34.875442 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 47.66
I20260201 21:07:34.875459 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 48 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:34.875607 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260201 21:07:35.052951 5012 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 48 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:35.053041 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 48 FOLLOWER]: Advancing to term 49
I20260201 21:07:35.053988 5012 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.054255 5012 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 49 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:35.054316 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.054316 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:35.054536 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 49 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:35.054629 5012 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Leader election lost for term 49. Reason: could not achieve majority
I20260201 21:07:35.063673 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 48. Current term is 49. Ops: []
I20260201 21:07:35.063859 5009 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 48.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260201 21:07:35.063946 5009 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 LEADER]: Stepping down as leader of term 48
I20260201 21:07:35.063970 5009 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:35.064031 5009 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.064106 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 48 FOLLOWER]: Advancing to term 49
I20260201 21:07:35.159260 5013 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 48 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:35.159345 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 48 FOLLOWER]: Advancing to term 49
I20260201 21:07:35.160267 5013 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.160449 5013 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 49 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:35.160665 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.160892 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:35.160972 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 49: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:35.161406 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 49 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 49.
I20260201 21:07:35.161553 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 49 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:35.161640 5013 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 FOLLOWER]: Leader election won for term 49
I20260201 21:07:35.161707 5013 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:35.161763 5013 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 49, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.162212 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 48 to 49, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 49 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:35.191090 5012 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:35.191143 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 49 FOLLOWER]: Advancing to term 50
I20260201 21:07:35.191737 5012 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.191840 5012 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 50 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:35.191989 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 50 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.192050 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 49 FOLLOWER]: Advancing to term 50
I20260201 21:07:35.192060 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 50 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:35.192652 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 50.
I20260201 21:07:35.192824 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:35.192917 5012 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 FOLLOWER]: Leader election won for term 50
I20260201 21:07:35.193029 5012 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:35.193091 5012 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.193571 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 49 to 50, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 50 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:35.257874 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 50 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 49. Current term is 50. Ops: []
I20260201 21:07:35.258091 5013 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260201 21:07:35.258198 5013 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 LEADER]: Stepping down as leader of term 49
I20260201 21:07:35.258236 5013 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:35.258293 5013 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 49.67, Last appended by leader: 67, Current term: 49, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.258359 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 49 FOLLOWER]: Advancing to term 50
I20260201 21:07:35.270742 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 50 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 49 index: 67. Preceding OpId from leader: term: 50 index: 67. (term mismatch)
I20260201 21:07:35.270787 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 66
I20260201 21:07:35.270799 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 49.67
I20260201 21:07:35.270812 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 50 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:35.270995 5012 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260201 21:07:35.271867 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 50 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 48 index: 66. Preceding OpId from leader: term: 50 index: 67. (index mismatch)
I20260201 21:07:35.272095 5015 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260201 21:07:35.530254 5013 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 50 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:35.530334 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 50 FOLLOWER]: Advancing to term 51
I20260201 21:07:35.530964 5013 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.531111 5013 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 51 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:35.531299 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:35.531325 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.531526 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:35.531616 5013 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20260201 21:07:35.544934 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 50. Current term is 51. Ops: []
I20260201 21:07:35.545145 5012 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 50.67, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260201 21:07:35.545255 5012 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 LEADER]: Stepping down as leader of term 50
I20260201 21:07:35.545285 5012 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:35.545338 5012 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.545403 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 50 FOLLOWER]: Advancing to term 51
I20260201 21:07:35.563855 5009 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 50 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:35.563908 5009 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 50 FOLLOWER]: Advancing to term 51
I20260201 21:07:35.564394 5009 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.564517 5009 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 51 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:35.564661 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:35.564662 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:35.564754 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 51: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:35.565275 4882 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 51.
I20260201 21:07:35.565420 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:35.565507 5009 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 FOLLOWER]: Leader election won for term 51
I20260201 21:07:35.565644 5009 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:35.565690 5009 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.566087 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 50 to 51, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 51 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:35.651376 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 50 index: 67. Preceding OpId from leader: term: 51 index: 68. (index mismatch)
I20260201 21:07:35.651592 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260201 21:07:35.652395 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 51 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 50 index: 67. Preceding OpId from leader: term: 51 index: 68. (index mismatch)
I20260201 21:07:35.652674 5009 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260201 21:07:35.659018 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:35.843086 5012 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 51 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:35.843161 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 51 FOLLOWER]: Advancing to term 52
I20260201 21:07:35.843747 5012 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.843883 5012 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 52 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:35.844026 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.844034 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:35.844259 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 52 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:35.844359 5012 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Leader election lost for term 52. Reason: could not achieve majority
I20260201 21:07:35.850562 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 51. Current term is 52. Ops: []
I20260201 21:07:35.850778 5017 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 51.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260201 21:07:35.850878 5017 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 LEADER]: Stepping down as leader of term 51
I20260201 21:07:35.850914 5017 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:35.850975 5017 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.851051 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 51 FOLLOWER]: Advancing to term 52
I20260201 21:07:35.940730 5013 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:35.940826 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 51 FOLLOWER]: Advancing to term 52
I20260201 21:07:35.941509 5013 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.941664 5013 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 52 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:35.941885 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.941886 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:35.942046 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 52: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:35.942546 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 52.
I20260201 21:07:35.942705 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:35.942781 5013 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 FOLLOWER]: Leader election won for term 52
I20260201 21:07:35.942906 5013 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:35.942960 5013 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.943363 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 51 to 52, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 52 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:35.985682 5012 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:35.985730 5012 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 52 FOLLOWER]: Advancing to term 53
I20260201 21:07:35.986203 5012 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.986315 5012 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 53 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:35.986424 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 53 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:35.986481 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 53 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:35.986486 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 52 FOLLOWER]: Advancing to term 53
I20260201 21:07:35.987028 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 53.
I20260201 21:07:35.987177 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:35.987251 5012 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 FOLLOWER]: Leader election won for term 53
I20260201 21:07:35.987309 5012 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:35.987373 5012 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:35.987742 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 52 to 53, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 53 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:36.022878 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 52. Current term is 53. Ops: []
I20260201 21:07:36.023087 5013 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260201 21:07:36.023149 5013 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 53.69 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 68
I20260201 21:07:36.023170 5013 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 LEADER]: Stepping down as leader of term 52
I20260201 21:07:36.023196 5013 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:36.023257 5013 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 52.69, Last appended by leader: 69, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.023320 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 52 FOLLOWER]: Advancing to term 53
I20260201 21:07:36.063001 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 53 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 51 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260201 21:07:36.063199 5012 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260201 21:07:36.064046 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 53 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 52 index: 69. Preceding OpId from leader: term: 53 index: 69. (term mismatch)
I20260201 21:07:36.064095 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 68
I20260201 21:07:36.064111 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 52.69
I20260201 21:07:36.064133 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 53 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:36.064311 5019 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260201 21:07:36.164315 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 53 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:36.164386 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 53 FOLLOWER]: Advancing to term 54
I20260201 21:07:36.164973 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.165102 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 54 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:36.165299 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:36.165302 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:36.165398 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 53 FOLLOWER]: Advancing to term 54
I20260201 21:07:36.165951 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 54.
I20260201 21:07:36.166110 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:36.166188 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 FOLLOWER]: Leader election won for term 54
I20260201 21:07:36.166251 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:36.166306 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.166658 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 53 to 54, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 54 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:36.184383 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 53. Current term is 54. Ops: []
I20260201 21:07:36.184574 5019 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 53.69, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260201 21:07:36.184659 5019 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 54.70 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 69
I20260201 21:07:36.184695 5015 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 LEADER]: Stepping down as leader of term 53
I20260201 21:07:36.184731 5015 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:36.184806 5015 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.184887 5015 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 53 FOLLOWER]: Advancing to term 54
I20260201 21:07:36.261036 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 54 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 54 index: 70. (index mismatch)
I20260201 21:07:36.261287 5017 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260201 21:07:36.262166 4882 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 54 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 54 index: 70. (index mismatch)
I20260201 21:07:36.262385 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260201 21:07:36.449481 5019 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 54 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:36.449570 5019 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 54 FOLLOWER]: Advancing to term 55
I20260201 21:07:36.450259 5019 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.450408 5019 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 55 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:36.450595 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:36.450611 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:36.450816 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:36.450958 5019 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260201 21:07:36.464754 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 54. Current term is 55. Ops: []
I20260201 21:07:36.464924 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 54.70, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260201 21:07:36.465018 5017 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 LEADER]: Stepping down as leader of term 54
I20260201 21:07:36.465080 5017 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:36.465119 5017 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 54.70, Last appended by leader: 70, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.465250 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 54 FOLLOWER]: Advancing to term 55
I20260201 21:07:36.524540 5013 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 54 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:36.524600 5013 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 54 FOLLOWER]: Advancing to term 55
I20260201 21:07:36.525144 5013 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.525303 5013 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 55 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:36.525460 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:36.525480 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:36.525542 4882 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 55: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:36.526016 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 55 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 55.
I20260201 21:07:36.526165 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 55 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:36.526260 5013 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 FOLLOWER]: Leader election won for term 55
I20260201 21:07:36.526302 5013 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:36.526351 5013 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 54.70, Last appended by leader: 70, Current term: 55, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.526721 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 54 to 55, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 55 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:36.554865 5019 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:36.554921 5019 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 55 FOLLOWER]: Advancing to term 56
I20260201 21:07:36.555447 5019 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.555562 5019 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 56 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:36.555686 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 56 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:36.555719 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 56 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:36.555804 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 55 FOLLOWER]: Advancing to term 56
I20260201 21:07:36.556278 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 56.
I20260201 21:07:36.556416 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:36.556505 5019 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 FOLLOWER]: Leader election won for term 56
I20260201 21:07:36.556560 5019 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:36.556593 5019 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 54.70, Last appended by leader: 70, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.556959 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 55 to 56, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 56 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:36.609118 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 55. Current term is 56. Ops: []
I20260201 21:07:36.609354 5013 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260201 21:07:36.609438 5013 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 56.71 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 70
I20260201 21:07:36.609477 5018 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 LEADER]: Stepping down as leader of term 55
I20260201 21:07:36.609544 5018 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:36.609597 5018 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 55.71, Last appended by leader: 71, Current term: 55, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.609668 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 55 FOLLOWER]: Advancing to term 56
I20260201 21:07:36.643369 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 56 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 55 index: 71. Preceding OpId from leader: term: 56 index: 71. (term mismatch)
I20260201 21:07:36.643414 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 70
I20260201 21:07:36.643426 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 55.71
I20260201 21:07:36.643440 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 56 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:36.643646 5019 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260201 21:07:36.644541 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 56 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 54 index: 70. Preceding OpId from leader: term: 56 index: 71. (index mismatch)
I20260201 21:07:36.644699 5019 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260201 21:07:36.659178 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:36.835371 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 56 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:36.835371 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 56 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:36.835502 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 56 FOLLOWER]: Advancing to term 57
I20260201 21:07:36.835511 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 56 FOLLOWER]: Advancing to term 57
I20260201 21:07:36.836269 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.836268 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.836467 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 57 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:36.836467 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 57 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:36.836630 4882 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 57 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:36.836659 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 57 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:36.836762 4807 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 57 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 57: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:36.836642 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 57 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:36.836639 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 57 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:36.836882 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 57 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:36.836881 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 57 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 57: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:36.836968 5018 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 57 FOLLOWER]: Leader election lost for term 57. Reason: could not achieve majority
I20260201 21:07:36.837037 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 57 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:36.837092 5017 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 57 FOLLOWER]: Leader election lost for term 57. Reason: could not achieve majority
I20260201 21:07:36.842284 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 57 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 56. Current term is 57. Ops: []
I20260201 21:07:36.842444 5015 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 56.71, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260201 21:07:36.842535 5015 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 LEADER]: Stepping down as leader of term 56
I20260201 21:07:36.842563 5015 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:36.842618 5015 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 56.71, Last appended by leader: 71, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.842679 5015 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 56 FOLLOWER]: Advancing to term 57
I20260201 21:07:36.937580 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 57 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:36.937675 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 57 FOLLOWER]: Advancing to term 58
I20260201 21:07:36.938261 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.938405 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 58 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:36.938601 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 58 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:36.938601 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 58 candidate_status { last_received { term: 56 index: 71 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:36.938704 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 57 FOLLOWER]: Advancing to term 58
I20260201 21:07:36.938709 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 57 FOLLOWER]: Advancing to term 58
I20260201 21:07:36.939383 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 58.
I20260201 21:07:36.939409 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 58.
I20260201 21:07:36.939561 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters:
I20260201 21:07:36.939653 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 FOLLOWER]: Leader election won for term 58
I20260201 21:07:36.939708 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:36.939756 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 56.71, Last appended by leader: 71, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:36.940146 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 56 to 58, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 58 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:37.018623 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 58 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 56 index: 71. Preceding OpId from leader: term: 58 index: 72. (index mismatch)
I20260201 21:07:37.018873 5017 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260201 21:07:37.019737 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 58 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 56 index: 71. Preceding OpId from leader: term: 58 index: 72. (index mismatch)
I20260201 21:07:37.019960 5021 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260201 21:07:37.207468 5019 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 58 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:37.207558 5019 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 58 FOLLOWER]: Advancing to term 59
I20260201 21:07:37.208194 5019 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.208411 5019 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 59 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:37.208606 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 59 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:37.208631 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 59 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.208837 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 59 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:37.208950 5019 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Leader election lost for term 59. Reason: could not achieve majority
I20260201 21:07:37.227223 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 58. Current term is 59. Ops: []
I20260201 21:07:37.227738 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 58.72, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260201 21:07:37.227893 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 LEADER]: Stepping down as leader of term 58
I20260201 21:07:37.227931 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:37.227989 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 58.72, Last appended by leader: 72, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.228070 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 58 FOLLOWER]: Advancing to term 59
I20260201 21:07:37.310395 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 58 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:37.310494 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 58 FOLLOWER]: Advancing to term 59
I20260201 21:07:37.311161 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.311335 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 59 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:37.311543 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 59 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:37.311568 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 59 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.311640 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 59: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:37.312244 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 59.
I20260201 21:07:37.312409 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:37.312484 5018 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 FOLLOWER]: Leader election won for term 59
I20260201 21:07:37.312582 5018 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:37.312625 5018 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 58.72, Last appended by leader: 72, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.312991 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 58 to 59, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 59 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:37.346431 5019 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:37.346500 5019 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 59 FOLLOWER]: Advancing to term 60
I20260201 21:07:37.347048 5019 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.347196 5019 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 60 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:37.347386 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 60 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:37.347386 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 60 candidate_status { last_received { term: 58 index: 72 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.347476 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 59 FOLLOWER]: Advancing to term 60
I20260201 21:07:37.348007 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 60 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 60.
I20260201 21:07:37.348161 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 60 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:37.348383 5019 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 FOLLOWER]: Leader election won for term 60
I20260201 21:07:37.348471 5019 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:37.348531 5019 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 58.72, Last appended by leader: 72, Current term: 60, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.348963 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 59 to 60, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 60 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:37.397550 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 60 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 59. Current term is 60. Ops: []
I20260201 21:07:37.397809 5018 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260201 21:07:37.397914 5018 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 LEADER]: Stepping down as leader of term 59
I20260201 21:07:37.397950 5018 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:37.398005 5018 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.73, Last appended by leader: 73, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.398072 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 59 FOLLOWER]: Advancing to term 60
I20260201 21:07:37.427506 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 60 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 59 index: 73. Preceding OpId from leader: term: 60 index: 73. (term mismatch)
I20260201 21:07:37.427563 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 72
I20260201 21:07:37.427575 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 59.73
I20260201 21:07:37.427588 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 60 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:37.427747 5019 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260201 21:07:37.428668 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 60 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 58 index: 72. Preceding OpId from leader: term: 60 index: 73. (index mismatch)
I20260201 21:07:37.428961 5019 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260201 21:07:37.634605 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 60 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:37.634694 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 60 FOLLOWER]: Advancing to term 61
I20260201 21:07:37.636088 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.636248 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 61 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:37.636466 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 61 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:37.636473 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 61 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.636727 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 61 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:37.636809 5018 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Leader election lost for term 61. Reason: could not achieve majority
I20260201 21:07:37.650997 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 60. Current term is 61. Ops: []
I20260201 21:07:37.651216 5015 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 60.73, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260201 21:07:37.651320 5015 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 LEADER]: Stepping down as leader of term 60
I20260201 21:07:37.651353 5015 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:37.651407 5015 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 60.73, Last appended by leader: 73, Current term: 60, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.651484 5015 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 60 FOLLOWER]: Advancing to term 61
I20260201 21:07:37.659339 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:37.726125 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 60 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:37.726222 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 60 FOLLOWER]: Advancing to term 61
I20260201 21:07:37.726898 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.727030 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 61 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:37.727226 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 61 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:37.727257 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 61 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:37.727309 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 61: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:37.727941 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 61.
I20260201 21:07:37.728106 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:37.728185 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 FOLLOWER]: Leader election won for term 61
I20260201 21:07:37.728261 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:37.728346 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 60.73, Last appended by leader: 73, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.728793 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 60 to 61, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 61 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:37.758306 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:37.758395 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 61 FOLLOWER]: Advancing to term 62
I20260201 21:07:37.758991 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.759137 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 62 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:37.759346 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 62 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:37.759357 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 62 candidate_status { last_received { term: 60 index: 73 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.759425 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 61 FOLLOWER]: Advancing to term 62
I20260201 21:07:37.759974 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 62 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 62.
I20260201 21:07:37.760123 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 62 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:37.760197 5018 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 FOLLOWER]: Leader election won for term 62
I20260201 21:07:37.760253 5018 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:37.760294 5018 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 60.73, Last appended by leader: 73, Current term: 62, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.760725 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 61 to 62, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 62 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:37.817212 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 61. Current term is 62. Ops: []
I20260201 21:07:37.817481 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260201 21:07:37.817574 5016 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 62.74 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 73
I20260201 21:07:37.817611 5017 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 LEADER]: Stepping down as leader of term 61
I20260201 21:07:37.817649 5017 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:37.817703 5017 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.74, Last appended by leader: 74, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.817751 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 61 FOLLOWER]: Advancing to term 62
I20260201 21:07:37.844348 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 62 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 61 index: 74. Preceding OpId from leader: term: 62 index: 74. (term mismatch)
I20260201 21:07:37.844424 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 73
I20260201 21:07:37.844439 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 61.74
I20260201 21:07:37.844451 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 62 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:37.844666 5018 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260201 21:07:37.845643 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 62 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 60 index: 73. Preceding OpId from leader: term: 62 index: 74. (index mismatch)
I20260201 21:07:37.845857 5022 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260201 21:07:37.947142 5015 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 62 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:37.947212 5015 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 62 FOLLOWER]: Advancing to term 63
I20260201 21:07:37.947772 5015 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.947886 5015 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 63 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:37.948035 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 63 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:37.948041 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 63 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:37.948282 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 63 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:37.948354 5015 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Leader election lost for term 63. Reason: could not achieve majority
I20260201 21:07:37.964597 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 62. Current term is 63. Ops: []
I20260201 21:07:37.964747 5024 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 62.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260201 21:07:37.964844 5018 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 LEADER]: Stepping down as leader of term 62
I20260201 21:07:37.964887 5018 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:37.964943 5018 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 62.74, Last appended by leader: 74, Current term: 62, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:37.965010 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 62 FOLLOWER]: Advancing to term 63
I20260201 21:07:38.043603 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 62 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:38.043674 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 62 FOLLOWER]: Advancing to term 63
I20260201 21:07:38.044212 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.044339 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 63 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:38.044493 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 63 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:38.044517 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 63 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:38.044584 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 63: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:38.044997 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 63.
I20260201 21:07:38.045136 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:38.045258 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 FOLLOWER]: Leader election won for term 63
I20260201 21:07:38.045300 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:38.045334 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 62.74, Last appended by leader: 74, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.045688 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 62 to 63, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 63 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:38.051635 5015 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:38.051673 5015 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 63 FOLLOWER]: Advancing to term 64
I20260201 21:07:38.052104 5015 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.052199 5015 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 64 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:38.052333 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 64 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:38.052336 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 64 candidate_status { last_received { term: 62 index: 74 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.052392 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 63 FOLLOWER]: Advancing to term 64
I20260201 21:07:38.052848 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 64 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 64.
I20260201 21:07:38.052960 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 64 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:38.053025 5015 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 FOLLOWER]: Leader election won for term 64
I20260201 21:07:38.053061 5015 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:38.053102 5015 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 62.74, Last appended by leader: 74, Current term: 64, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.053433 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 63 to 64, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 64 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:38.130710 4807 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 LEADER]: Stepping down as leader of term 63
I20260201 21:07:38.130770 4807 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:38.130829 4807 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.75, Last appended by leader: 75, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.130908 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 63 FOLLOWER]: Advancing to term 64
I20260201 21:07:38.131500 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 64 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 63 index: 75. Preceding OpId from leader: term: 64 index: 75. (term mismatch)
I20260201 21:07:38.131538 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 74
I20260201 21:07:38.131558 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 63.75
I20260201 21:07:38.131577 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 64 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:38.131790 5015 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260201 21:07:38.132661 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 64 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 62 index: 74. Preceding OpId from leader: term: 64 index: 75. (index mismatch)
I20260201 21:07:38.132825 5025 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260201 21:07:38.233819 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 64 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:38.233897 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 64 FOLLOWER]: Advancing to term 65
I20260201 21:07:38.234498 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.234642 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 65 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:38.234802 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:38.234802 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 65 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.235013 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 65 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:38.235116 5018 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 65 FOLLOWER]: Leader election lost for term 65. Reason: could not achieve majority
I20260201 21:07:38.246009 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 65 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 64. Current term is 65. Ops: []
I20260201 21:07:38.246170 5023 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 64.75, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260201 21:07:38.246263 5023 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 LEADER]: Stepping down as leader of term 64
I20260201 21:07:38.246297 5023 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:38.246358 5023 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 64.75, Last appended by leader: 75, Current term: 64, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.246428 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 64 FOLLOWER]: Advancing to term 65
I20260201 21:07:38.347419 5018 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 65 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:38.347484 5018 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 65 FOLLOWER]: Advancing to term 66
I20260201 21:07:38.347985 5018 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.348093 5018 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 66 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:38.348237 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 66 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.348325 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 64 FOLLOWER]: Advancing to term 66
I20260201 21:07:38.348366 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 66 candidate_status { last_received { term: 64 index: 75 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:38.348462 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 65 FOLLOWER]: Advancing to term 66
I20260201 21:07:38.348891 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 66.
I20260201 21:07:38.349067 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 66.
I20260201 21:07:38.349073 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 66 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters:
I20260201 21:07:38.349187 5018 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 FOLLOWER]: Leader election won for term 66
I20260201 21:07:38.349238 5018 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:38.349289 5018 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 64.75, Last appended by leader: 75, Current term: 66, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.349768 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 64 to 66, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 66 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:38.455206 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 66 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 64 index: 75. Preceding OpId from leader: term: 66 index: 76. (index mismatch)
I20260201 21:07:38.455404 5018 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260201 21:07:38.456269 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 66 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 64 index: 75. Preceding OpId from leader: term: 66 index: 76. (index mismatch)
I20260201 21:07:38.456430 5018 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260201 21:07:38.635550 5023 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 66 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:38.635627 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 66 FOLLOWER]: Advancing to term 67
I20260201 21:07:38.636240 5023 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.636369 5023 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 67 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:38.636507 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:38.636509 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.636709 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 67 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:38.636786 5023 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Leader election lost for term 67. Reason: could not achieve majority
I20260201 21:07:38.657487 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 66. Current term is 67. Ops: []
I20260201 21:07:38.657655 5024 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 66.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260201 21:07:38.657745 5022 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 LEADER]: Stepping down as leader of term 66
I20260201 21:07:38.657786 5022 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:38.657845 5022 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 66, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.657914 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 66 FOLLOWER]: Advancing to term 67
I20260201 21:07:38.659521 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:38.718861 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 66 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:38.718916 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 66 FOLLOWER]: Advancing to term 67
I20260201 21:07:38.719434 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.719558 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 67 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:38.719688 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:38.719691 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:38.719779 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 67: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:38.720219 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 67.
I20260201 21:07:38.720373 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:38.720476 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 FOLLOWER]: Leader election won for term 67
I20260201 21:07:38.720534 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:38.720618 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.721004 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 66 to 67, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 67 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:38.754191 5023 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:38.754257 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 67 FOLLOWER]: Advancing to term 68
I20260201 21:07:38.754698 5023 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.754812 5023 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 68 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:38.754920 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 68 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.754940 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 68 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:38.755012 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 67 FOLLOWER]: Advancing to term 68
I20260201 21:07:38.755436 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 68 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 68.
I20260201 21:07:38.755571 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 68 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:38.755656 5023 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 FOLLOWER]: Leader election won for term 68
I20260201 21:07:38.755797 5023 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:38.755846 5023 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 68, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.756155 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 67 to 68, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 68 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:38.799468 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 67. Current term is 68. Ops: []
I20260201 21:07:38.799636 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260201 21:07:38.799710 5016 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 68.77 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 76
I20260201 21:07:38.799741 5017 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 LEADER]: Stepping down as leader of term 67
I20260201 21:07:38.799783 5017 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:38.799837 5017 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 67.77, Last appended by leader: 77, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.799898 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 67 FOLLOWER]: Advancing to term 68
I20260201 21:07:38.846619 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 68 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 67 index: 77. Preceding OpId from leader: term: 68 index: 77. (term mismatch)
I20260201 21:07:38.846660 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 76
I20260201 21:07:38.846680 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 67.77
I20260201 21:07:38.846700 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 68 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:38.846869 5023 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260201 21:07:38.847666 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 68 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 66 index: 76. Preceding OpId from leader: term: 68 index: 77. (index mismatch)
I20260201 21:07:38.847863 5027 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260201 21:07:38.948523 5022 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 68 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:38.948590 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 68 FOLLOWER]: Advancing to term 69
I20260201 21:07:38.949185 5022 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.949322 5022 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 69 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:38.949451 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:38.949455 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:38.949641 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 69 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:38.949715 5022 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Leader election lost for term 69. Reason: could not achieve majority
I20260201 21:07:38.968518 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 68. Current term is 69. Ops: []
I20260201 21:07:38.968724 5023 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 68.77, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260201 21:07:38.968819 5023 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 LEADER]: Stepping down as leader of term 68
I20260201 21:07:38.968851 5023 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:38.968924 5023 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 68, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:38.968982 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 68 FOLLOWER]: Advancing to term 69
I20260201 21:07:39.026285 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 68 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:39.026338 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 68 FOLLOWER]: Advancing to term 69
I20260201 21:07:39.026810 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.026925 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 69 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.027048 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:39.027050 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.027138 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 69: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:39.027642 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 69.
I20260201 21:07:39.027794 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:39.027881 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 FOLLOWER]: Leader election won for term 69
I20260201 21:07:39.027964 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:39.028020 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.028451 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 68 to 69, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 69 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:39.052019 5022 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:39.052060 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 69 FOLLOWER]: Advancing to term 70
I20260201 21:07:39.052498 5022 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.052608 5022 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 70 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:39.052732 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 70 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:39.052736 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 70 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:39.052814 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 69 FOLLOWER]: Advancing to term 70
I20260201 21:07:39.053315 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 70 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 70.
I20260201 21:07:39.053447 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 70 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:39.053524 5022 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 FOLLOWER]: Leader election won for term 70
I20260201 21:07:39.053572 5022 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:39.053629 5022 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 70, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.053941 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 69 to 70, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 70 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:39.129505 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 70 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 69. Current term is 70. Ops: []
I20260201 21:07:39.129710 5017 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260201 21:07:39.129810 5017 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 LEADER]: Stepping down as leader of term 69
I20260201 21:07:39.129841 5017 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:39.129889 5017 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 69.78, Last appended by leader: 78, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.129937 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 69 FOLLOWER]: Advancing to term 70
I20260201 21:07:39.142287 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 70 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 68 index: 77. Preceding OpId from leader: term: 70 index: 78. (index mismatch)
I20260201 21:07:39.142463 5022 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260201 21:07:39.143335 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 70 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 69 index: 78. Preceding OpId from leader: term: 70 index: 78. (term mismatch)
I20260201 21:07:39.143384 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 77
I20260201 21:07:39.143402 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 69.78
I20260201 21:07:39.143422 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 70 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:39.143623 5022 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260201 21:07:39.243693 5023 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 70 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:39.243774 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 70 FOLLOWER]: Advancing to term 71
I20260201 21:07:39.244406 5023 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.244553 5023 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 71 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.244760 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.244761 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:39.244854 4807 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 70 FOLLOWER]: Advancing to term 71
I20260201 21:07:39.245469 4807 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 71.
I20260201 21:07:39.245620 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:39.245708 5023 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 FOLLOWER]: Leader election won for term 71
I20260201 21:07:39.245760 5023 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:39.245815 5023 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 70.78, Last appended by leader: 78, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.246237 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 70 to 71, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 71 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:39.246546 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 71 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 70. Current term is 71. Ops: []
I20260201 21:07:39.246711 5028 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 70.78, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260201 21:07:39.246775 5028 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 LEADER]: Stepping down as leader of term 70
I20260201 21:07:39.246804 5028 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:39.246851 5028 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 70.78, Last appended by leader: 78, Current term: 70, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.246925 5028 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 70 FOLLOWER]: Advancing to term 71
I20260201 21:07:39.347674 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 71 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 70 index: 78. Preceding OpId from leader: term: 71 index: 79. (index mismatch)
I20260201 21:07:39.347878 5023 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260201 21:07:39.348793 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 71 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 70 index: 78. Preceding OpId from leader: term: 71 index: 79. (index mismatch)
I20260201 21:07:39.348954 5026 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260201 21:07:39.449807 5017 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 71 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:39.449882 5017 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 71 FOLLOWER]: Advancing to term 72
I20260201 21:07:39.450484 5017 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.450662 5017 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 72 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.450814 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.450814 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 72 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:39.450907 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 71 FOLLOWER]: Advancing to term 72
I20260201 21:07:39.451484 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 72 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 72.
I20260201 21:07:39.451635 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 72 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:39.451719 5017 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 FOLLOWER]: Leader election won for term 72
I20260201 21:07:39.451766 5017 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:39.451809 5017 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 72, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.452174 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 71 to 72, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 72 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:39.466200 4807 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 71. Current term is 72. Ops: []
I20260201 21:07:39.466374 5023 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 71.79, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260201 21:07:39.466449 5023 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 72.80 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 79
I20260201 21:07:39.466478 5026 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 LEADER]: Stepping down as leader of term 71
I20260201 21:07:39.466535 5026 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:39.466591 5026 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.466667 5026 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 71 FOLLOWER]: Advancing to term 72
I20260201 21:07:39.559580 5028 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:39.559655 5028 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 72 FOLLOWER]: Advancing to term 73
I20260201 21:07:39.560137 5028 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.560258 5028 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 73 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:39.560375 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 73 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:39.560405 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 73 candidate_status { last_received { term: 71 index: 79 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:39.560451 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 72 FOLLOWER]: Advancing to term 73
I20260201 21:07:39.560961 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 73.
I20260201 21:07:39.561132 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:39.561313 5028 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 FOLLOWER]: Leader election won for term 73
I20260201 21:07:39.561372 5028 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:39.561425 5028 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 71.79, Last appended by leader: 79, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.561829 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 72 to 73, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 73 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:39.572888 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 73 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 72. Current term is 73. Ops: []
I20260201 21:07:39.573081 5017 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260201 21:07:39.573174 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 LEADER]: Stepping down as leader of term 72
I20260201 21:07:39.573210 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:39.573275 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 72.80, Last appended by leader: 80, Current term: 72, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.573328 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 72 FOLLOWER]: Advancing to term 73
I20260201 21:07:39.653390 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 73 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 71 index: 79. Preceding OpId from leader: term: 73 index: 80. (index mismatch)
I20260201 21:07:39.653575 5028 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260201 21:07:39.654461 4807 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 73 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 72 index: 80. Preceding OpId from leader: term: 73 index: 80. (term mismatch)
I20260201 21:07:39.654515 4807 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 79
I20260201 21:07:39.654536 4807 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 72.80
I20260201 21:07:39.654556 4807 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 73 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:39.654675 5028 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260201 21:07:39.659683 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:39.845181 5026 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 73 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:39.845292 5026 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 73 FOLLOWER]: Advancing to term 74
I20260201 21:07:39.845867 5026 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.845991 5026 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 74 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.846179 4807 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:39.846184 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.846452 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:39.846544 5026 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260201 21:07:39.848357 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 73. Current term is 74. Ops: []
I20260201 21:07:39.848639 5022 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 73.80, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260201 21:07:39.848733 5022 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 LEADER]: Stepping down as leader of term 73
I20260201 21:07:39.848752 5022 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:39.848795 5022 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.848866 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 73 FOLLOWER]: Advancing to term 74
I20260201 21:07:39.947360 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 73 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:39.947444 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 73 FOLLOWER]: Advancing to term 74
I20260201 21:07:39.948027 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.948163 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 74 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.948356 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:39.948402 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.948416 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 74: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:39.949025 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 74.
I20260201 21:07:39.949190 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 74 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:39.949277 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 FOLLOWER]: Leader election won for term 74
I20260201 21:07:39.949326 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:39.949373 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 74, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.949744 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 73 to 74, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 74 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:39.963820 5026 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:39.963869 5026 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 74 FOLLOWER]: Advancing to term 75
I20260201 21:07:39.964329 5026 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.964424 5026 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 75 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:39.964562 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:39.964608 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 74 FOLLOWER]: Advancing to term 75
I20260201 21:07:39.964583 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:39.965060 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 75 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 75.
I20260201 21:07:39.965209 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 75 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:39.965278 5026 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 FOLLOWER]: Leader election won for term 75
I20260201 21:07:39.965327 5026 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:39.965372 5026 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 75, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:39.965709 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 74 to 75, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 75 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:40.036051 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 75 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 74. Current term is 75. Ops: []
I20260201 21:07:40.036243 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260201 21:07:40.036314 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 LEADER]: Stepping down as leader of term 74
I20260201 21:07:40.036345 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:40.036391 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 74.81, Last appended by leader: 81, Current term: 74, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.036450 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 74 FOLLOWER]: Advancing to term 75
I20260201 21:07:40.055949 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 75 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 74 index: 81. Preceding OpId from leader: term: 75 index: 81. (term mismatch)
I20260201 21:07:40.055994 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 80
I20260201 21:07:40.056015 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 74.81
I20260201 21:07:40.056034 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 75 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:40.056195 5026 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260201 21:07:40.057137 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 75 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 73 index: 80. Preceding OpId from leader: term: 75 index: 81. (index mismatch)
I20260201 21:07:40.057330 5023 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260201 21:07:40.261904 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 75 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:40.261997 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 75 FOLLOWER]: Advancing to term 76
I20260201 21:07:40.262801 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.262984 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 76 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:40.263115 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:40.263348 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:40.263533 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 76 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:40.263624 5016 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Leader election lost for term 76. Reason: could not achieve majority
I20260201 21:07:40.277987 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 75. Current term is 76. Ops: []
I20260201 21:07:40.278203 5026 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 75.81, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260201 21:07:40.278326 5023 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 LEADER]: Stepping down as leader of term 75
I20260201 21:07:40.278388 5023 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:40.278447 5023 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 75, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.278532 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 75 FOLLOWER]: Advancing to term 76
I20260201 21:07:40.344035 5024 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 75 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:40.344099 5024 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 75 FOLLOWER]: Advancing to term 76
I20260201 21:07:40.344699 5024 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.344823 5024 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 76 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:40.344969 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:40.344973 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:40.345031 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 76: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:40.345574 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 76.
I20260201 21:07:40.345709 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:40.345793 5024 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 FOLLOWER]: Leader election won for term 76
I20260201 21:07:40.345841 5024 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:40.345889 5024 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.346282 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 75 to 76, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 76 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:40.385988 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:40.386050 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 76 FOLLOWER]: Advancing to term 77
I20260201 21:07:40.386525 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.386628 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 77 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:40.386739 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:40.386744 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:40.386802 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 76 FOLLOWER]: Advancing to term 77
I20260201 21:07:40.387233 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 77 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 77.
I20260201 21:07:40.387408 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 77 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:40.387492 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 FOLLOWER]: Leader election won for term 77
I20260201 21:07:40.387537 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:40.387617 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 77, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.387953 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 76 to 77, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 77 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:40.446691 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 76. Current term is 77. Ops: []
I20260201 21:07:40.446879 5024 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260201 21:07:40.446951 5024 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 77.82 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 81
I20260201 21:07:40.446988 5022 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 LEADER]: Stepping down as leader of term 76
I20260201 21:07:40.447021 5022 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:40.447063 5022 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 76.82, Last appended by leader: 82, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.447126 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 76 FOLLOWER]: Advancing to term 77
I20260201 21:07:40.480453 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 77 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 75 index: 81. Preceding OpId from leader: term: 77 index: 82. (index mismatch)
I20260201 21:07:40.480649 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260201 21:07:40.481508 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 77 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 76 index: 82. Preceding OpId from leader: term: 77 index: 82. (term mismatch)
I20260201 21:07:40.481557 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 81
I20260201 21:07:40.481575 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 76.82
I20260201 21:07:40.481598 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 77 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:40.481771 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260201 21:07:40.659920 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:40.673424 5023 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 77 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:40.673481 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 77 FOLLOWER]: Advancing to term 78
I20260201 21:07:40.674012 5023 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.674124 5023 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 78 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:40.674278 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:40.674293 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:40.674467 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 78 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:40.674567 5023 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Leader election lost for term 78. Reason: could not achieve majority
I20260201 21:07:40.690543 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 77. Current term is 78. Ops: []
I20260201 21:07:40.690768 5017 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 77.82, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260201 21:07:40.690899 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 LEADER]: Stepping down as leader of term 77
I20260201 21:07:40.690948 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:40.691009 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 77, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.691088 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 77 FOLLOWER]: Advancing to term 78
I20260201 21:07:40.706642 5022 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 77 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:40.706694 5022 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 77 FOLLOWER]: Advancing to term 78
I20260201 21:07:40.707168 5022 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.707293 5022 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 78 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:40.707396 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:40.707397 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:40.707492 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 78: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:40.707952 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 78.
I20260201 21:07:40.708076 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:40.708151 5022 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 FOLLOWER]: Leader election won for term 78
I20260201 21:07:40.708205 5022 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:40.708287 5022 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:40.708698 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 77 to 78, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 78 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:40.783954 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 78 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 77 index: 82. Preceding OpId from leader: term: 78 index: 83. (index mismatch)
I20260201 21:07:40.784157 5022 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260201 21:07:40.785037 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 77 index: 82. Preceding OpId from leader: term: 78 index: 83. (index mismatch)
I20260201 21:07:40.785220 5030 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260201 21:07:41.005625 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 78 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:41.005697 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 78 FOLLOWER]: Advancing to term 79
I20260201 21:07:41.006251 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.006402 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 79 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.006549 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:41.006544 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.006754 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 79 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:41.006835 5016 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Leader election lost for term 79. Reason: could not achieve majority
I20260201 21:07:41.012647 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 78. Current term is 79. Ops: []
I20260201 21:07:41.012832 5030 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 78.83, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260201 21:07:41.012912 5030 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 LEADER]: Stepping down as leader of term 78
I20260201 21:07:41.012940 5030 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:41.012996 5030 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.013059 5030 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 78 FOLLOWER]: Advancing to term 79
I20260201 21:07:41.080626 5023 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:41.080708 5023 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 78 FOLLOWER]: Advancing to term 79
I20260201 21:07:41.081336 5023 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.081476 5023 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 79 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.081651 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.081655 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 79 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:41.081748 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 79: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:41.082286 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 79 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 79.
I20260201 21:07:41.082505 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 79 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:41.082618 5023 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 FOLLOWER]: Leader election won for term 79
I20260201 21:07:41.082724 5023 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:41.082815 5023 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 79, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.083231 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 78 to 79, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 79 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:41.145162 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:41.145226 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 79 FOLLOWER]: Advancing to term 80
I20260201 21:07:41.145735 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.145855 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 80 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.145993 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 80 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:41.145996 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 80 candidate_status { last_received { term: 78 index: 83 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.146080 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 79 FOLLOWER]: Advancing to term 80
I20260201 21:07:41.146559 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 80.
I20260201 21:07:41.146718 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:41.146792 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 FOLLOWER]: Leader election won for term 80
I20260201 21:07:41.146838 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:41.146879 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 78.83, Last appended by leader: 83, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.147253 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 79 to 80, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 80 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:41.184442 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 79. Current term is 80. Ops: []
I20260201 21:07:41.184634 5023 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260201 21:07:41.184702 5023 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 80.84 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 83
I20260201 21:07:41.184760 5031 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 LEADER]: Stepping down as leader of term 79
I20260201 21:07:41.184798 5031 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:41.184860 5031 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 79.84, Last appended by leader: 84, Current term: 79, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.185004 5031 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 79 FOLLOWER]: Advancing to term 80
I20260201 21:07:41.224684 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 80 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 79 index: 84. Preceding OpId from leader: term: 80 index: 84. (term mismatch)
I20260201 21:07:41.224742 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 83
I20260201 21:07:41.224756 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 79.84
I20260201 21:07:41.224767 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 80 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:41.224937 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260201 21:07:41.227810 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 80 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 78 index: 83. Preceding OpId from leader: term: 80 index: 84. (index mismatch)
I20260201 21:07:41.228102 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260201 21:07:41.587816 5031 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 80 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:41.587898 5031 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 80 FOLLOWER]: Advancing to term 81
I20260201 21:07:41.588536 5031 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.588694 5031 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 81 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.588897 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:41.588897 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.589170 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:41.589247 5031 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260201 21:07:41.593106 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 80. Current term is 81. Ops: []
I20260201 21:07:41.593289 5017 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 80.84, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260201 21:07:41.593379 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 LEADER]: Stepping down as leader of term 80
I20260201 21:07:41.593426 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:41.593480 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 80.84, Last appended by leader: 84, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.593549 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 80 FOLLOWER]: Advancing to term 81
I20260201 21:07:41.660104 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:41.692170 5030 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 80 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:41.692232 5030 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 80 FOLLOWER]: Advancing to term 81
I20260201 21:07:41.692781 5030 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.692934 5030 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 81 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:41.693089 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:41.693090 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 81 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:41.693217 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 81: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:41.693668 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 81 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 81.
I20260201 21:07:41.693809 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 81 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:41.693897 5030 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 FOLLOWER]: Leader election won for term 81
I20260201 21:07:41.694000 5030 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:41.694056 5030 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 80.84, Last appended by leader: 84, Current term: 81, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.694449 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 80 to 81, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 81 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:41.697458 5031 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:41.697500 5031 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 81 FOLLOWER]: Advancing to term 82
I20260201 21:07:41.697943 5031 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.698045 5031 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 82 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.698145 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 82 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:41.698153 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 82 candidate_status { last_received { term: 80 index: 84 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.698197 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 81 FOLLOWER]: Advancing to term 82
I20260201 21:07:41.698695 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 82.
I20260201 21:07:41.698832 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:41.698901 5031 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 FOLLOWER]: Leader election won for term 82
I20260201 21:07:41.699004 5031 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:41.699038 5031 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 80.84, Last appended by leader: 84, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.699396 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 81 to 82, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 82 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:41.791427 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 82 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 80 index: 84. Preceding OpId from leader: term: 82 index: 85. (index mismatch)
I20260201 21:07:41.791674 5031 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260201 21:07:41.792546 4731 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 LEADER]: Stepping down as leader of term 81
I20260201 21:07:41.792588 4731 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:41.792639 4731 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 81.85, Last appended by leader: 85, Current term: 81, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.792706 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 81 FOLLOWER]: Advancing to term 82
I20260201 21:07:41.793366 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 82 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 81 index: 85. Preceding OpId from leader: term: 82 index: 85. (term mismatch)
I20260201 21:07:41.793399 4731 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 84
I20260201 21:07:41.793419 4731 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 81.85
I20260201 21:07:41.793438 4731 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 82 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:41.793660 5037 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260201 21:07:41.892985 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 82 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:41.893054 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 82 FOLLOWER]: Advancing to term 83
I20260201 21:07:41.893754 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.893922 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 83 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:41.894098 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:41.894119 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:41.894182 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 82 FOLLOWER]: Advancing to term 83
I20260201 21:07:41.894789 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 83 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 83.
I20260201 21:07:41.894943 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 83 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:41.895037 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 FOLLOWER]: Leader election won for term 83
I20260201 21:07:41.895094 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:41.895146 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 83, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.895581 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 82 to 83, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 83 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:41.899832 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 82. Current term is 83. Ops: []
I20260201 21:07:41.900010 5037 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 82.85, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260201 21:07:41.900081 5037 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 83.86 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 85
I20260201 21:07:41.900113 5031 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 LEADER]: Stepping down as leader of term 82
I20260201 21:07:41.900151 5031 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:41.900220 5031 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:41.900301 5031 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 82 FOLLOWER]: Advancing to term 83
I20260201 21:07:41.981868 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 83 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 82 index: 85. Preceding OpId from leader: term: 83 index: 86. (index mismatch)
I20260201 21:07:41.982079 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260201 21:07:41.982883 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 83 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 82 index: 85. Preceding OpId from leader: term: 83 index: 86. (index mismatch)
I20260201 21:07:41.983054 5038 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260201 21:07:42.084137 5030 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 83 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:42.084219 5030 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 83 FOLLOWER]: Advancing to term 84
I20260201 21:07:42.084836 5030 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.084962 5030 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 84 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:42.085110 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 84 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.085122 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 84 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.085353 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 84 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:42.085433 5030 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Leader election lost for term 84. Reason: could not achieve majority
I20260201 21:07:42.093268 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 83. Current term is 84. Ops: []
I20260201 21:07:42.093449 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 83.86, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260201 21:07:42.093540 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 LEADER]: Stepping down as leader of term 83
I20260201 21:07:42.093583 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:42.093631 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 83.86, Last appended by leader: 86, Current term: 83, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.093693 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 83 FOLLOWER]: Advancing to term 84
I20260201 21:07:42.165302 5031 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 83 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:42.165377 5031 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 83 FOLLOWER]: Advancing to term 84
I20260201 21:07:42.165947 5031 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.166075 5031 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 84 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:42.166240 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 84 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:42.166256 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 84 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.166313 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 84: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:42.166848 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 84.
I20260201 21:07:42.167027 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:42.167111 5031 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 FOLLOWER]: Leader election won for term 84
I20260201 21:07:42.167160 5031 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:42.167210 5031 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 83.86, Last appended by leader: 86, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.167593 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 83 to 84, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 84 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:42.202836 5030 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:42.202889 5030 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 84 FOLLOWER]: Advancing to term 85
I20260201 21:07:42.203397 5030 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.203506 5030 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 85 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:42.203658 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 85 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.203663 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 85 candidate_status { last_received { term: 83 index: 86 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.203713 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 84 FOLLOWER]: Advancing to term 85
I20260201 21:07:42.204187 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 85 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 85.
I20260201 21:07:42.204337 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 85 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:42.204414 5030 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 FOLLOWER]: Leader election won for term 85
I20260201 21:07:42.204499 5030 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:42.204542 5030 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 83.86, Last appended by leader: 86, Current term: 85, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.204916 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 84 to 85, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 85 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:42.272918 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 85 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 84. Current term is 85. Ops: []
I20260201 21:07:42.273092 5031 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260201 21:07:42.273190 5037 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 LEADER]: Stepping down as leader of term 84
I20260201 21:07:42.273240 5037 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:42.273295 5037 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 84.87, Last appended by leader: 87, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.273370 5037 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 84 FOLLOWER]: Advancing to term 85
I20260201 21:07:42.320412 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 85 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 83 index: 86. Preceding OpId from leader: term: 85 index: 87. (index mismatch)
I20260201 21:07:42.320605 5030 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260201 21:07:42.321463 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 85 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 84 index: 87. Preceding OpId from leader: term: 85 index: 87. (term mismatch)
I20260201 21:07:42.321508 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 86
I20260201 21:07:42.321545 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 84.87
I20260201 21:07:42.321568 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 85 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:42.321722 5030 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260201 21:07:42.421830 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 85 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:42.421907 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 85 FOLLOWER]: Advancing to term 86
I20260201 21:07:42.422492 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.422626 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 86 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:42.422817 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:42.422828 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.422922 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 85 FOLLOWER]: Advancing to term 86
I20260201 21:07:42.423518 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 86.
I20260201 21:07:42.423664 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:42.423743 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 FOLLOWER]: Leader election won for term 86
I20260201 21:07:42.423801 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:42.423856 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.424242 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 85 to 86, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 86 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:42.426952 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 86 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 85. Current term is 86. Ops: []
I20260201 21:07:42.427142 5040 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 85.87, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260201 21:07:42.427234 5040 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 LEADER]: Stepping down as leader of term 85
I20260201 21:07:42.427263 5040 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:42.427309 5040 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 85, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.427373 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 85 FOLLOWER]: Advancing to term 86
I20260201 21:07:42.514683 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 86 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 85 index: 87. Preceding OpId from leader: term: 86 index: 88. (index mismatch)
I20260201 21:07:42.514897 5016 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260201 21:07:42.515568 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 86 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 85 index: 87. Preceding OpId from leader: term: 86 index: 88. (index mismatch)
I20260201 21:07:42.515811 5038 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260201 21:07:42.616812 5037 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 86 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:42.616896 5037 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 86 FOLLOWER]: Advancing to term 87
I20260201 21:07:42.617537 5037 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.617663 5037 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 87 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:42.617828 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 87 candidate_status { last_received { term: 86 index: 88 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.617831 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 87 candidate_status { last_received { term: 86 index: 88 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:42.617928 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 86 FOLLOWER]: Advancing to term 87
I20260201 21:07:42.618397 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 87 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 87.
I20260201 21:07:42.618536 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 87 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:42.618611 5037 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 FOLLOWER]: Leader election won for term 87
I20260201 21:07:42.618667 5037 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:42.618714 5037 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 86.88, Last appended by leader: 88, Current term: 87, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.619117 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 86 to 87, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 87 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:42.620918 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 87 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 86. Current term is 87. Ops: []
I20260201 21:07:42.621081 5038 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 86.88, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260201 21:07:42.621181 5038 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 LEADER]: Stepping down as leader of term 86
I20260201 21:07:42.621217 5038 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:42.621268 5038 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 86.88, Last appended by leader: 88, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.621351 5038 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 86 FOLLOWER]: Advancing to term 87
I20260201 21:07:42.660351 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:42.700404 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 87 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 86 index: 88. Preceding OpId from leader: term: 87 index: 89. (index mismatch)
I20260201 21:07:42.700584 5037 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260201 21:07:42.701462 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 87 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 86 index: 88. Preceding OpId from leader: term: 87 index: 89. (index mismatch)
I20260201 21:07:42.701617 5031 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260201 21:07:42.803002 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 87 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:42.803092 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 87 FOLLOWER]: Advancing to term 88
I20260201 21:07:42.803699 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.803823 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 88 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:42.803980 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 88 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.803992 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 88 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.804190 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 88 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:42.804282 5040 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Leader election lost for term 88. Reason: could not achieve majority
I20260201 21:07:42.825975 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 87. Current term is 88. Ops: []
I20260201 21:07:42.826184 5041 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 87.89, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260201 21:07:42.826287 5041 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 LEADER]: Stepping down as leader of term 87
I20260201 21:07:42.826318 5041 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:42.826375 5041 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 87.89, Last appended by leader: 89, Current term: 87, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.826445 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 87 FOLLOWER]: Advancing to term 88
I20260201 21:07:42.888093 5038 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 87 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:42.888190 5038 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 87 FOLLOWER]: Advancing to term 88
I20260201 21:07:42.888857 5038 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.889011 5038 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 88 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:42.889226 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 88 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:42.889294 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 88: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:42.889281 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 88 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.889937 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 88.
I20260201 21:07:42.890103 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:42.890188 5038 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 FOLLOWER]: Leader election won for term 88
I20260201 21:07:42.890241 5038 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:42.890297 5038 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 87.89, Last appended by leader: 89, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.890703 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 87 to 88, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 88 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:42.937908 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:42.937988 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 88 FOLLOWER]: Advancing to term 89
I20260201 21:07:42.938565 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.938689 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 89 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:42.938880 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 89 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:42.938880 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 89 candidate_status { last_received { term: 87 index: 89 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:42.938977 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 88 FOLLOWER]: Advancing to term 89
I20260201 21:07:42.939481 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 89.
I20260201 21:07:42.939646 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:42.939739 5040 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 FOLLOWER]: Leader election won for term 89
I20260201 21:07:42.939862 5040 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:42.939913 5040 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 87.89, Last appended by leader: 89, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.940310 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 88 to 89, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 89 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:42.977298 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 89 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 88. Current term is 89. Ops: []
I20260201 21:07:42.977519 5038 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260201 21:07:42.977607 5038 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 LEADER]: Stepping down as leader of term 88
I20260201 21:07:42.977638 5038 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:42.977697 5038 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 88.90, Last appended by leader: 90, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:42.977757 5038 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 88 FOLLOWER]: Advancing to term 89
I20260201 21:07:43.031898 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 89 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 87 index: 89. Preceding OpId from leader: term: 89 index: 90. (index mismatch)
I20260201 21:07:43.032140 5040 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260201 21:07:43.032969 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 89 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 88 index: 90. Preceding OpId from leader: term: 89 index: 90. (term mismatch)
I20260201 21:07:43.033139 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 89
I20260201 21:07:43.033188 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 88.90
I20260201 21:07:43.033210 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 89 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:43.033371 5042 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260201 21:07:43.133342 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 89 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:43.133447 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 89 FOLLOWER]: Advancing to term 90
I20260201 21:07:43.134126 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.134267 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 90 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:43.134438 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 90 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:43.134438 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 90 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:43.134671 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 90 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:43.134752 5041 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Leader election lost for term 90. Reason: could not achieve majority
I20260201 21:07:43.139309 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 89. Current term is 90. Ops: []
I20260201 21:07:43.139490 5042 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 89.90, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260201 21:07:43.139595 5040 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 LEADER]: Stepping down as leader of term 89
I20260201 21:07:43.139642 5040 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:43.139703 5040 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 89.90, Last appended by leader: 90, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.139775 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 89 FOLLOWER]: Advancing to term 90
I20260201 21:07:43.220196 5038 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 89 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:43.220296 5038 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 89 FOLLOWER]: Advancing to term 90
I20260201 21:07:43.221009 5038 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.221206 5038 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 90 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:43.221354 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 90 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:43.221364 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 90 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:43.221454 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 90: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:43.221978 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 90.
I20260201 21:07:43.222193 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:43.222267 5038 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 FOLLOWER]: Leader election won for term 90
I20260201 21:07:43.222317 5038 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:43.222370 5038 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 89.90, Last appended by leader: 90, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.222777 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 89 to 90, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 90 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:43.242713 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:43.242798 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 90 FOLLOWER]: Advancing to term 91
I20260201 21:07:43.243361 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.243489 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 91 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:43.243669 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 91 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:43.243669 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 91 candidate_status { last_received { term: 89 index: 90 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:43.243775 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 90 FOLLOWER]: Advancing to term 91
I20260201 21:07:43.244321 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 91 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 91.
I20260201 21:07:43.244477 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 91 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:43.244560 5041 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 FOLLOWER]: Leader election won for term 91
I20260201 21:07:43.244614 5041 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:43.244668 5041 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 89.90, Last appended by leader: 90, Current term: 91, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.245047 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 90 to 91, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 91 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:43.305385 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 90. Current term is 91. Ops: []
I20260201 21:07:43.305639 5038 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260201 21:07:43.305725 5038 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 91.91 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 90
I20260201 21:07:43.305761 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 LEADER]: Stepping down as leader of term 90
I20260201 21:07:43.305794 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:43.305845 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.91, Last appended by leader: 91, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.305918 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 90 FOLLOWER]: Advancing to term 91
I20260201 21:07:43.341421 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 91 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 89 index: 90. Preceding OpId from leader: term: 91 index: 91. (index mismatch)
I20260201 21:07:43.341692 5041 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260201 21:07:43.342535 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 91 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 90 index: 91. Preceding OpId from leader: term: 91 index: 91. (term mismatch)
I20260201 21:07:43.342577 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 90
I20260201 21:07:43.342595 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 90.91
I20260201 21:07:43.342612 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 91 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:43.342851 5041 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260201 21:07:43.536720 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 91 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:43.536818 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 91 FOLLOWER]: Advancing to term 92
I20260201 21:07:43.537575 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.537721 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 92 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:43.537897 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 92 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:43.537895 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 92 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:43.538162 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:43.538241 5040 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260201 21:07:43.559877 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 91. Current term is 92. Ops: []
I20260201 21:07:43.560061 5044 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 91.91, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260201 21:07:43.560164 5044 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 LEADER]: Stepping down as leader of term 91
I20260201 21:07:43.560195 5044 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:43.560253 5044 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 91.91, Last appended by leader: 91, Current term: 91, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.560326 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 91 FOLLOWER]: Advancing to term 92
I20260201 21:07:43.649710 5016 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 91 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:43.649797 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 91 FOLLOWER]: Advancing to term 92
I20260201 21:07:43.650384 5016 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.650534 5016 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 92 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:43.650705 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 92 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:43.650709 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 92 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:43.650823 4731 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 92: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:43.651388 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 92 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 92.
I20260201 21:07:43.651556 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 92 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:43.651645 5016 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 FOLLOWER]: Leader election won for term 92
I20260201 21:07:43.651705 5016 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:43.651762 5016 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 91.91, Last appended by leader: 91, Current term: 92, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.652225 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 91 to 92, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 92 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:43.660861 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:43.673230 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:43.673286 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 92 FOLLOWER]: Advancing to term 93
I20260201 21:07:43.673789 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.673909 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 93 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:43.674036 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 93 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:43.674050 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 93 candidate_status { last_received { term: 91 index: 91 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:43.674099 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 92 FOLLOWER]: Advancing to term 93
I20260201 21:07:43.674616 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 93.
I20260201 21:07:43.674777 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 93 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:43.674865 5040 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 FOLLOWER]: Leader election won for term 93
I20260201 21:07:43.674965 5040 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:43.675010 5040 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 91.91, Last appended by leader: 91, Current term: 93, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.675397 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 92 to 93, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 93 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:43.756672 4731 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 92. Current term is 93. Ops: []
I20260201 21:07:43.756673 4806 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 LEADER]: Stepping down as leader of term 92
I20260201 21:07:43.756796 4806 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:43.756872 4806 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.92, Last appended by leader: 92, Current term: 92, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.756953 5016 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260201 21:07:43.757016 5016 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 93.92 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 91
I20260201 21:07:43.757104 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 92 FOLLOWER]: Advancing to term 93
I20260201 21:07:43.757742 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 93 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 92 index: 92. Preceding OpId from leader: term: 93 index: 92. (term mismatch)
I20260201 21:07:43.757781 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 91
I20260201 21:07:43.757802 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 92.92
I20260201 21:07:43.757823 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 93 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:43.758008 5040 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260201 21:07:43.758855 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 93 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 91 index: 91. Preceding OpId from leader: term: 93 index: 92. (index mismatch)
I20260201 21:07:43.759004 5045 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260201 21:07:43.860020 5044 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 93 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:43.860100 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 93 FOLLOWER]: Advancing to term 94
I20260201 21:07:43.860728 5044 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.860864 5044 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 94 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:43.861054 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 94 candidate_status { last_received { term: 93 index: 92 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:43.861076 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 94 candidate_status { last_received { term: 93 index: 92 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:43.861132 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 93 FOLLOWER]: Advancing to term 94
I20260201 21:07:43.861688 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 94.
I20260201 21:07:43.861874 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 94 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:43.861974 5044 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 FOLLOWER]: Leader election won for term 94
I20260201 21:07:43.862035 5044 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:43.862109 5044 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 93.92, Last appended by leader: 92, Current term: 94, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.862483 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 93 to 94, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 94 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:43.871347 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 93. Current term is 94. Ops: []
I20260201 21:07:43.871554 5046 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 93.92, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260201 21:07:43.871649 5046 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 94.93 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 92
I20260201 21:07:43.871692 5040 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 LEADER]: Stepping down as leader of term 93
I20260201 21:07:43.871744 5040 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:43.871809 5040 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 93.92, Last appended by leader: 92, Current term: 93, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:43.871886 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 93 FOLLOWER]: Advancing to term 94
I20260201 21:07:43.965432 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 94 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 93 index: 92. Preceding OpId from leader: term: 94 index: 93. (index mismatch)
I20260201 21:07:43.965691 5044 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260201 21:07:43.966583 4731 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 94 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 93 index: 92. Preceding OpId from leader: term: 94 index: 93. (index mismatch)
I20260201 21:07:43.966758 5047 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260201 21:07:44.067641 5038 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 94 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:44.067744 5038 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 94 FOLLOWER]: Advancing to term 95
I20260201 21:07:44.068403 5038 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.068565 5038 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 95 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:44.068760 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 95 candidate_status { last_received { term: 94 index: 93 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:44.068760 4731 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 95 candidate_status { last_received { term: 94 index: 93 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:44.068889 4731 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 94 FOLLOWER]: Advancing to term 95
I20260201 21:07:44.069607 4731 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 95.
I20260201 21:07:44.069700 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 95 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 94. Current term is 95. Ops: []
I20260201 21:07:44.069787 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:44.069907 5038 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 FOLLOWER]: Leader election won for term 95
I20260201 21:07:44.069959 5038 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:44.069995 5041 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 94.93, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260201 21:07:44.070047 5038 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 94.93, Last appended by leader: 93, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.070086 5044 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 LEADER]: Stepping down as leader of term 94
I20260201 21:07:44.070143 5044 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:44.070191 5044 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 94.93, Last appended by leader: 93, Current term: 94, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.070312 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 94 FOLLOWER]: Advancing to term 95
I20260201 21:07:44.070385 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 94 to 95, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 95 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:44.156805 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 95 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 94 index: 93. Preceding OpId from leader: term: 95 index: 94. (index mismatch)
I20260201 21:07:44.157048 5038 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260201 21:07:44.157752 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 95 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 94 index: 93. Preceding OpId from leader: term: 95 index: 94. (index mismatch)
I20260201 21:07:44.157929 5038 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260201 21:07:44.359248 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 95 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:44.359349 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 95 FOLLOWER]: Advancing to term 96
I20260201 21:07:44.359982 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.360129 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 96 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:44.360332 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 96 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:44.360404 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 96 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:44.360641 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 96 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:44.360723 5040 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Leader election lost for term 96. Reason: could not achieve majority
I20260201 21:07:44.374820 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 95. Current term is 96. Ops: []
I20260201 21:07:44.375017 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 95.94, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260201 21:07:44.375129 5016 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 LEADER]: Stepping down as leader of term 95
I20260201 21:07:44.375164 5016 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:44.375267 5016 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 95.94, Last appended by leader: 94, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.375350 5016 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 95 FOLLOWER]: Advancing to term 96
I20260201 21:07:44.431442 5044 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 95 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:44.431552 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 95 FOLLOWER]: Advancing to term 96
I20260201 21:07:44.432212 5044 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.432367 5044 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 96 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:44.432552 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 96 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:44.432628 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 96: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:44.432564 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 96 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:44.433178 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 96 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 96.
I20260201 21:07:44.433318 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 96 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:44.433395 5044 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 FOLLOWER]: Leader election won for term 96
I20260201 21:07:44.433454 5044 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:44.433506 5044 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 95.94, Last appended by leader: 94, Current term: 96, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.433919 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 95 to 96, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 96 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:44.510308 5040 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:44.510413 5040 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 96 FOLLOWER]: Advancing to term 97
I20260201 21:07:44.511086 5040 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.511238 5040 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 97 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:44.511447 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 97 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:44.511458 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 97 candidate_status { last_received { term: 95 index: 94 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:44.511556 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 96 FOLLOWER]: Advancing to term 97
I20260201 21:07:44.512120 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 97 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 97.
I20260201 21:07:44.512285 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 97 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:44.512378 5040 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 FOLLOWER]: Leader election won for term 97
I20260201 21:07:44.512427 5040 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:44.512478 5040 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 95.94, Last appended by leader: 94, Current term: 97, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.512910 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 96 to 97, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 97 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:44.513059 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 97 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 96. Current term is 97. Ops: []
I20260201 21:07:44.513242 5044 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260201 21:07:44.513351 5041 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 LEADER]: Stepping down as leader of term 96
I20260201 21:07:44.513391 5041 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:44.513443 5041 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 96.95, Last appended by leader: 95, Current term: 96, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.513528 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 96 FOLLOWER]: Advancing to term 97
I20260201 21:07:44.602319 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 97 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 96 index: 95. Preceding OpId from leader: term: 97 index: 95. (term mismatch)
I20260201 21:07:44.602406 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 94
I20260201 21:07:44.602428 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 96.95
I20260201 21:07:44.602445 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 97 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:44.602651 5040 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260201 21:07:44.603545 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 97 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 95 index: 94. Preceding OpId from leader: term: 97 index: 95. (index mismatch)
I20260201 21:07:44.603721 5040 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260201 21:07:44.661114 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:44.704183 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 97 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:44.704236 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 97 FOLLOWER]: Advancing to term 98
I20260201 21:07:44.704883 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.705008 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 98 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:44.705132 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 98 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:44.705138 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 98 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:44.705335 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 98 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:44.705416 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Leader election lost for term 98. Reason: could not achieve majority
I20260201 21:07:44.709400 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 97. Current term is 98. Ops: []
I20260201 21:07:44.709579 5049 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 97.95, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260201 21:07:44.709676 5049 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 LEADER]: Stepping down as leader of term 97
I20260201 21:07:44.709708 5049 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:44.709762 5049 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 97.95, Last appended by leader: 95, Current term: 97, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.709832 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 97 FOLLOWER]: Advancing to term 98
I20260201 21:07:44.791009 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 97 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:44.791062 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 97 FOLLOWER]: Advancing to term 98
I20260201 21:07:44.791657 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.791774 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 98 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:44.791914 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 98 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:44.791914 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 98 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:44.792027 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 98: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:44.792538 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 98.
I20260201 21:07:44.792670 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:44.792755 5041 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 FOLLOWER]: Leader election won for term 98
I20260201 21:07:44.792797 5041 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:44.792829 5041 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 97.95, Last appended by leader: 95, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.793221 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 97 to 98, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 98 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:44.843924 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:44.843974 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 98 FOLLOWER]: Advancing to term 99
I20260201 21:07:44.844429 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.844532 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 99 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:44.844657 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 99 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:44.844659 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 99 candidate_status { last_received { term: 97 index: 95 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:44.844739 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 98 FOLLOWER]: Advancing to term 99
I20260201 21:07:44.845203 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 99.
I20260201 21:07:44.845345 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 99 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:44.845412 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 FOLLOWER]: Leader election won for term 99
I20260201 21:07:44.845454 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:44.845487 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 97.95, Last appended by leader: 95, Current term: 99, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.845830 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 98 to 99, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 99 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:44.869113 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 98. Current term is 99. Ops: []
I20260201 21:07:44.869275 5041 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260201 21:07:44.869352 5041 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 99.96 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 95
I20260201 21:07:44.869383 5044 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 LEADER]: Stepping down as leader of term 98
I20260201 21:07:44.869427 5044 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:44.869482 5044 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 98.96, Last appended by leader: 96, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:44.869545 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 98 FOLLOWER]: Advancing to term 99
I20260201 21:07:44.960511 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 99 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 98 index: 96. Preceding OpId from leader: term: 99 index: 96. (term mismatch)
I20260201 21:07:44.960592 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 95
I20260201 21:07:44.960604 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 98.96
I20260201 21:07:44.960618 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 99 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:44.960808 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260201 21:07:44.961820 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 99 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 97 index: 95. Preceding OpId from leader: term: 99 index: 96. (index mismatch)
I20260201 21:07:44.962000 5050 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260201 21:07:45.063056 5046 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 99 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:45.063134 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 99 FOLLOWER]: Advancing to term 100
I20260201 21:07:45.063819 5046 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.063972 5046 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 100 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:45.064110 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 100 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.064106 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 100 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.064366 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 100 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:45.064450 5046 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Leader election lost for term 100. Reason: could not achieve majority
I20260201 21:07:45.078377 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 99. Current term is 100. Ops: []
I20260201 21:07:45.078595 5050 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 99.96, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260201 21:07:45.078688 5050 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 LEADER]: Stepping down as leader of term 99
I20260201 21:07:45.078711 5050 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:45.078755 5050 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 99.96, Last appended by leader: 96, Current term: 99, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.078837 5050 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 99 FOLLOWER]: Advancing to term 100
I20260201 21:07:45.147831 5044 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 99 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:45.147899 5044 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 99 FOLLOWER]: Advancing to term 100
I20260201 21:07:45.148479 5044 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.148619 5044 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 100 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:45.148793 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 100 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:45.148860 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 100: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:45.148800 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 100 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.149497 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 100.
I20260201 21:07:45.149647 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:45.149718 5044 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 FOLLOWER]: Leader election won for term 100
I20260201 21:07:45.149770 5044 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:45.149816 5044 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 99.96, Last appended by leader: 96, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.150166 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 99 to 100, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 100 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:45.213927 5046 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:45.213999 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 100 FOLLOWER]: Advancing to term 101
I20260201 21:07:45.214533 5046 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.214661 5046 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 101 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:45.214831 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 101 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.214897 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 100 FOLLOWER]: Advancing to term 101
I20260201 21:07:45.214831 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 101 candidate_status { last_received { term: 99 index: 96 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.215446 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 101.
I20260201 21:07:45.215577 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:45.215643 5046 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 FOLLOWER]: Leader election won for term 101
I20260201 21:07:45.215690 5046 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:45.215740 5046 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 99.96, Last appended by leader: 96, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.216132 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 100 to 101, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 101 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:45.245582 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 100. Current term is 101. Ops: []
I20260201 21:07:45.245810 5044 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260201 21:07:45.245901 5044 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 101.97 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 96
I20260201 21:07:45.245950 5041 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 LEADER]: Stepping down as leader of term 100
I20260201 21:07:45.245991 5041 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:45.246039 5041 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.97, Last appended by leader: 97, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.246116 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 100 FOLLOWER]: Advancing to term 101
I20260201 21:07:45.299381 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 101 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 99 index: 96. Preceding OpId from leader: term: 101 index: 97. (index mismatch)
I20260201 21:07:45.299588 5046 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260201 21:07:45.300434 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 101 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 100 index: 97. Preceding OpId from leader: term: 101 index: 97. (term mismatch)
I20260201 21:07:45.300530 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 96
I20260201 21:07:45.300549 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 100.97
I20260201 21:07:45.300568 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 101 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:45.300762 5049 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260201 21:07:45.400782 5050 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 101 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:45.400849 5050 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 101 FOLLOWER]: Advancing to term 102
I20260201 21:07:45.401481 5050 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.401623 5050 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 102 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:45.401788 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 102 candidate_status { last_received { term: 101 index: 97 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.401811 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 102 candidate_status { last_received { term: 101 index: 97 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:45.401866 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 101 FOLLOWER]: Advancing to term 102
I20260201 21:07:45.402393 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 102 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 102.
I20260201 21:07:45.402539 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 102 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:45.402624 5050 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 FOLLOWER]: Leader election won for term 102
I20260201 21:07:45.402680 5050 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:45.402731 5050 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 101.97, Last appended by leader: 97, Current term: 102, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.403141 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 101 to 102, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 102 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:45.412302 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 101. Current term is 102. Ops: []
I20260201 21:07:45.412488 5049 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 101.97, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260201 21:07:45.412561 5049 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 102.98 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 97
I20260201 21:07:45.412585 5046 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 LEADER]: Stepping down as leader of term 101
I20260201 21:07:45.412633 5046 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:45.412693 5046 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 101.97, Last appended by leader: 97, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.412765 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 101 FOLLOWER]: Advancing to term 102
I20260201 21:07:45.491981 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 102 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 101 index: 97. Preceding OpId from leader: term: 102 index: 98. (index mismatch)
I20260201 21:07:45.492236 5050 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260201 21:07:45.493059 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 102 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 101 index: 97. Preceding OpId from leader: term: 102 index: 98. (index mismatch)
I20260201 21:07:45.493299 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260201 21:07:45.593947 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:45.594010 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 102 FOLLOWER]: Advancing to term 103
I20260201 21:07:45.594619 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.594735 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 103 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:45.594861 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 103 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.594861 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 103 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:45.595068 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 103 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:45.595160 5041 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Leader election lost for term 103. Reason: could not achieve majority
I20260201 21:07:45.609390 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 102. Current term is 103. Ops: []
I20260201 21:07:45.609565 5050 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 102.98, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260201 21:07:45.609673 5050 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 LEADER]: Stepping down as leader of term 102
I20260201 21:07:45.609702 5050 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:45.609757 5050 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 102.98, Last appended by leader: 98, Current term: 102, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.609838 5050 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 102 FOLLOWER]: Advancing to term 103
I20260201 21:07:45.661341 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:45.688086 5046 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:45.688148 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 102 FOLLOWER]: Advancing to term 103
I20260201 21:07:45.688714 5046 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.688849 5046 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 103 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:45.688990 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 103 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.688990 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 103 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.689085 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 103: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:45.689564 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 103 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 103.
I20260201 21:07:45.689702 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 103 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:45.689785 5046 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 FOLLOWER]: Leader election won for term 103
I20260201 21:07:45.689833 5046 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:45.689870 5046 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 102.98, Last appended by leader: 98, Current term: 103, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.690237 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 102 to 103, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 103 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:45.713768 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:45.713816 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 103 FOLLOWER]: Advancing to term 104
I20260201 21:07:45.714272 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.714375 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 104 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:45.714479 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 104 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.714498 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 104 candidate_status { last_received { term: 102 index: 98 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:45.714536 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 103 FOLLOWER]: Advancing to term 104
I20260201 21:07:45.715014 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 104.
I20260201 21:07:45.715157 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 104 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:45.715229 5041 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 FOLLOWER]: Leader election won for term 104
I20260201 21:07:45.715270 5041 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:45.715328 5041 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 102.98, Last appended by leader: 98, Current term: 104, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.715672 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 103 to 104, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 104 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:45.769564 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 104 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 103. Current term is 104. Ops: []
I20260201 21:07:45.769749 5046 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260201 21:07:45.769825 5046 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 LEADER]: Stepping down as leader of term 103
I20260201 21:07:45.769855 5046 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:45.769902 5046 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 103.99, Last appended by leader: 99, Current term: 103, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.769963 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 103 FOLLOWER]: Advancing to term 104
I20260201 21:07:45.793927 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 104 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 103 index: 99. Preceding OpId from leader: term: 104 index: 99. (term mismatch)
I20260201 21:07:45.793967 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 98
I20260201 21:07:45.793985 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 103.99
I20260201 21:07:45.794003 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 104 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:45.794170 5041 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260201 21:07:45.794936 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 104 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 102 index: 98. Preceding OpId from leader: term: 104 index: 99. (index mismatch)
I20260201 21:07:45.795203 5051 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260201 21:07:45.896668 5050 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 104 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:45.896729 5050 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 104 FOLLOWER]: Advancing to term 105
I20260201 21:07:45.897261 5050 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.897367 5050 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 105 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:45.897488 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.897507 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:45.897675 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 105 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:45.897753 5050 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Leader election lost for term 105. Reason: could not achieve majority
I20260201 21:07:45.900260 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 104. Current term is 105. Ops: []
I20260201 21:07:45.900408 5051 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 104.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260201 21:07:45.900497 5051 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 LEADER]: Stepping down as leader of term 104
I20260201 21:07:45.900537 5051 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:45.900588 5051 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 104, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.900657 5051 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 104 FOLLOWER]: Advancing to term 105
I20260201 21:07:45.996095 5046 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 104 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:45.996186 5046 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 104 FOLLOWER]: Advancing to term 105
I20260201 21:07:45.996769 5046 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.996914 5046 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 105 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:45.997108 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:45.997123 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 105 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:45.997234 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 105: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:45.997685 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 105.
I20260201 21:07:45.997821 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 105 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:45.997892 5046 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 FOLLOWER]: Leader election won for term 105
I20260201 21:07:45.997936 5046 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:45.997977 5046 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 105, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:45.998359 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 104 to 105, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 105 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:46.046883 5050 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:46.046939 5050 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 105 FOLLOWER]: Advancing to term 106
I20260201 21:07:46.047468 5050 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.047588 5050 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 106 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.047731 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 106 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.047730 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 106 candidate_status { last_received { term: 104 index: 99 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.047801 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 105 FOLLOWER]: Advancing to term 106
I20260201 21:07:46.048336 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 106 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 106.
I20260201 21:07:46.048480 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 106 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:46.048561 5050 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 FOLLOWER]: Leader election won for term 106
I20260201 21:07:46.048616 5050 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:46.048669 5050 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 104.99, Last appended by leader: 99, Current term: 106, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.049084 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 105 to 106, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 106 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:46.096844 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 106 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 105. Current term is 106. Ops: []
I20260201 21:07:46.097079 5046 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260201 21:07:46.097188 5049 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 LEADER]: Stepping down as leader of term 105
I20260201 21:07:46.097244 5049 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:46.097313 5049 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 105.100, Last appended by leader: 100, Current term: 105, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.097384 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 105 FOLLOWER]: Advancing to term 106
I20260201 21:07:46.126286 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 106 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 105 index: 100. Preceding OpId from leader: term: 106 index: 100. (term mismatch)
I20260201 21:07:46.126344 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 99
I20260201 21:07:46.126364 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 105.100
I20260201 21:07:46.126384 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 106 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:46.126567 5050 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260201 21:07:46.127382 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 106 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 104 index: 99. Preceding OpId from leader: term: 106 index: 100. (index mismatch)
I20260201 21:07:46.127621 5050 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260201 21:07:46.228443 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 106 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:46.228555 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 106 FOLLOWER]: Advancing to term 107
I20260201 21:07:46.229205 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.229360 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 107 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.229547 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.229553 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.229771 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:46.229851 5041 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260201 21:07:46.235299 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 106. Current term is 107. Ops: []
I20260201 21:07:46.235460 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 106.100, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260201 21:07:46.235556 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 LEADER]: Stepping down as leader of term 106
I20260201 21:07:46.235589 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:46.235639 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 106.100, Last appended by leader: 100, Current term: 106, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.235718 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 106 FOLLOWER]: Advancing to term 107
I20260201 21:07:46.323035 5049 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 106 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:46.323130 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 106 FOLLOWER]: Advancing to term 107
I20260201 21:07:46.323814 5049 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.323973 5049 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 107 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:46.324134 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.324189 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 107 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.324307 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 107: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:46.324733 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 107 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 107.
I20260201 21:07:46.324877 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 107 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:46.324946 5049 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 FOLLOWER]: Leader election won for term 107
I20260201 21:07:46.324995 5049 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:46.325029 5049 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 106.100, Last appended by leader: 100, Current term: 107, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.325505 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 106 to 107, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 107 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:46.340301 5041 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:46.340355 5041 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 107 FOLLOWER]: Advancing to term 108
I20260201 21:07:46.340883 5041 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.341008 5041 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 108 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.341177 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 108 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.341184 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 108 candidate_status { last_received { term: 106 index: 100 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.341264 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 107 FOLLOWER]: Advancing to term 108
I20260201 21:07:46.341812 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 108.
I20260201 21:07:46.341974 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:46.342061 5041 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 FOLLOWER]: Leader election won for term 108
I20260201 21:07:46.342118 5041 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:46.342172 5041 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 106.100, Last appended by leader: 100, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.342607 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 107 to 108, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 108 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:46.410902 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 108 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 107. Current term is 108. Ops: []
I20260201 21:07:46.411209 5049 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260201 21:07:46.411357 5049 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 LEADER]: Stepping down as leader of term 107
I20260201 21:07:46.411393 5049 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:46.411470 5049 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 107.101, Last appended by leader: 101, Current term: 107, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.411542 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 107 FOLLOWER]: Advancing to term 108
I20260201 21:07:46.444880 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 108 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 106 index: 100. Preceding OpId from leader: term: 108 index: 101. (index mismatch)
I20260201 21:07:46.445233 5041 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260201 21:07:46.446105 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 108 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 107 index: 101. Preceding OpId from leader: term: 108 index: 101. (term mismatch)
I20260201 21:07:46.446146 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 100
I20260201 21:07:46.446166 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 107.101
I20260201 21:07:46.446182 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 108 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:46.446336 5052 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260201 21:07:46.623788 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 108 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:46.623891 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 108 FOLLOWER]: Advancing to term 109
I20260201 21:07:46.624536 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.624687 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 109 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.624876 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 109 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.624876 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 109 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.625113 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 109 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:46.625214 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 109 FOLLOWER]: Leader election lost for term 109. Reason: could not achieve majority
I20260201 21:07:46.635496 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 109 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 108. Current term is 109. Ops: []
I20260201 21:07:46.635667 5051 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 108.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260201 21:07:46.635797 5052 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 LEADER]: Stepping down as leader of term 108
I20260201 21:07:46.635839 5052 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:46.635893 5052 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 108.101, Last appended by leader: 101, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.636003 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 108 FOLLOWER]: Advancing to term 109
I20260201 21:07:46.661563 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:46.726826 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 109 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:46.726929 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 109 FOLLOWER]: Advancing to term 110
I20260201 21:07:46.727666 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.727826 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 110 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.728004 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 110 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.728008 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 110 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.728089 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 109 FOLLOWER]: Advancing to term 110
I20260201 21:07:46.728659 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 110.
I20260201 21:07:46.728816 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 110 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:46.728907 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 FOLLOWER]: Leader election won for term 110
I20260201 21:07:46.728952 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:46.729009 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 108.101, Last appended by leader: 101, Current term: 110, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.729487 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 108 to 110, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 110 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:46.736770 5049 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 108 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:46.736819 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 108 FOLLOWER]: Advancing to term 109
I20260201 21:07:46.737336 5049 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.737447 5049 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 109 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:46.737609 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 109 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.737610 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 109 candidate_status { last_received { term: 108 index: 101 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.737681 4881 raft_consensus.cc:2368] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 109. Current term is 110.
I20260201 21:07:46.737833 4694 leader_election.cc:400] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 109 election: Vote denied by peer 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 109. Current term is 110.
I20260201 21:07:46.737862 4694 leader_election.cc:403] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 109 election: Cancelling election due to peer responding with higher term
I20260201 21:07:46.737916 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 109 FOLLOWER]: Advancing to term 110
I20260201 21:07:46.738368 5049 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 110 FOLLOWER]: Leader election lost for term 109. Reason: Vote denied by peer 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179) with higher term. Message: Invalid argument: T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for earlier term 109. Current term is 110.
I20260201 21:07:46.809432 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 110 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 108 index: 101. Preceding OpId from leader: term: 110 index: 102. (index mismatch)
I20260201 21:07:46.809715 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260201 21:07:46.810616 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 108 index: 101. Preceding OpId from leader: term: 110 index: 102. (index mismatch)
I20260201 21:07:46.810789 5050 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260201 21:07:46.911857 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:46.911939 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 110 FOLLOWER]: Advancing to term 111
I20260201 21:07:46.913136 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.913295 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 111 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:46.913434 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:46.913434 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.913625 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 111 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:46.913726 5052 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Leader election lost for term 111. Reason: could not achieve majority
I20260201 21:07:46.932142 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 110. Current term is 111. Ops: []
I20260201 21:07:46.932338 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 110.102, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260201 21:07:46.932458 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 LEADER]: Stepping down as leader of term 110
I20260201 21:07:46.932495 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:46.932550 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 110.102, Last appended by leader: 102, Current term: 110, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.932617 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 110 FOLLOWER]: Advancing to term 111
I20260201 21:07:46.998150 5049 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 110 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:46.998210 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 110 FOLLOWER]: Advancing to term 111
I20260201 21:07:46.998759 5049 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:46.998883 5049 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 111 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:46.999046 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:46.999053 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:46.999157 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 111: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:46.999660 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 111 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 111.
I20260201 21:07:46.999797 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 111 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:46.999868 5049 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 FOLLOWER]: Leader election won for term 111
I20260201 21:07:46.999976 5049 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.000022 5049 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 110.102, Last appended by leader: 102, Current term: 111, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.000401 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 110 to 111, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 111 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:47.049464 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.049535 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 111 FOLLOWER]: Advancing to term 112
I20260201 21:07:47.050026 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.050128 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 112 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.050283 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.050298 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.050351 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 111 FOLLOWER]: Advancing to term 112
I20260201 21:07:47.050891 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 112.
I20260201 21:07:47.051039 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 112 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.051105 5052 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 FOLLOWER]: Leader election won for term 112
I20260201 21:07:47.051146 5052 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:47.051195 5052 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 110.102, Last appended by leader: 102, Current term: 112, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.051620 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 111 to 112, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 112 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:47.086766 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 111. Current term is 112. Ops: []
I20260201 21:07:47.086956 5049 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260201 21:07:47.087040 5049 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 112.103 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 102
I20260201 21:07:47.087077 5053 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 LEADER]: Stepping down as leader of term 111
I20260201 21:07:47.087116 5053 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.087177 5053 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 111.103, Last appended by leader: 103, Current term: 111, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.087244 5053 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 111 FOLLOWER]: Advancing to term 112
I20260201 21:07:47.133900 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 112 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 110 index: 102. Preceding OpId from leader: term: 112 index: 103. (index mismatch)
I20260201 21:07:47.134112 5052 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260201 21:07:47.134981 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 112 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 111 index: 103. Preceding OpId from leader: term: 112 index: 103. (term mismatch)
I20260201 21:07:47.135026 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 102
I20260201 21:07:47.135042 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 111.103
I20260201 21:07:47.135059 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 112 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:47.135236 5051 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260201 21:07:47.235112 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 112 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:47.235180 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 112 FOLLOWER]: Advancing to term 113
I20260201 21:07:47.235786 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.235888 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 112. Current term is 113. Ops: []
I20260201 21:07:47.235936 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 113 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.236084 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:47.236117 5051 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 112.103, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.236111 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.236299 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 113 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:47.236310 5052 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 LEADER]: Stepping down as leader of term 112
I20260201 21:07:47.236364 5052 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:47.236411 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Leader election lost for term 113. Reason: could not achieve majority
I20260201 21:07:47.236411 5052 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 112, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.236570 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 112 FOLLOWER]: Advancing to term 113
I20260201 21:07:47.325608 5053 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 112 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:47.325706 5053 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 112 FOLLOWER]: Advancing to term 113
I20260201 21:07:47.326247 5053 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.326377 5053 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 113 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:47.326524 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.326548 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:47.326617 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 113: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:47.327106 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 113.
I20260201 21:07:47.327255 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:47.327327 5053 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 FOLLOWER]: Leader election won for term 113
I20260201 21:07:47.327373 5053 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.327412 5053 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.327803 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 112 to 113, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 113 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:47.356886 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.356931 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 113 FOLLOWER]: Advancing to term 114
I20260201 21:07:47.357375 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.357471 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 114 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.357620 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 114 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:47.357666 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 114 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.357673 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 113 FOLLOWER]: Advancing to term 114
I20260201 21:07:47.358228 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 114 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 114.
I20260201 21:07:47.358413 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 114 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.358500 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 FOLLOWER]: Leader election won for term 114
I20260201 21:07:47.358552 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:47.358601 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 114, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.358961 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 113 to 114, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 114 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:47.432108 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 114 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 113. Current term is 114. Ops: []
I20260201 21:07:47.432303 5053 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.432397 5053 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 LEADER]: Stepping down as leader of term 113
I20260201 21:07:47.432435 5053 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.432492 5053 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 113.104, Last appended by leader: 104, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.432569 5053 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 113 FOLLOWER]: Advancing to term 114
I20260201 21:07:47.461865 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 114 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.461915 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 114 FOLLOWER]: Advancing to term 115
I20260201 21:07:47.462383 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.462496 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 115 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.462654 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 115 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.462664 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 115 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.462735 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 114 FOLLOWER]: Advancing to term 115
I20260201 21:07:47.463155 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 115 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 114. Current term is 115. Ops: []
I20260201 21:07:47.463321 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.463352 4730 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 115 because replica has last-logged OpId of term: 113 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 112 index: 103.
I20260201 21:07:47.463389 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 LEADER]: Stepping down as leader of term 114
I20260201 21:07:47.463418 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:47.463459 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 114.104, Last appended by leader: 104, Current term: 114, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.463505 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 115 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.463539 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 114 FOLLOWER]: Advancing to term 115
I20260201 21:07:47.463582 5052 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 115 FOLLOWER]: Leader election lost for term 115. Reason: could not achieve majority
I20260201 21:07:47.564973 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 115 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.565035 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 115 FOLLOWER]: Advancing to term 116
I20260201 21:07:47.565583 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.565687 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 116 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.565833 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 116 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.565850 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 116 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.565903 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 115 FOLLOWER]: Advancing to term 116
I20260201 21:07:47.565912 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 115 FOLLOWER]: Advancing to term 116
I20260201 21:07:47.566488 4730 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 116 because replica has last-logged OpId of term: 113 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 112 index: 103.
I20260201 21:07:47.566488 4806 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 116 because replica has last-logged OpId of term: 114 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 112 index: 103.
I20260201 21:07:47.566694 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.566762 5052 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260201 21:07:47.661772 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:47.671165 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 116 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.671219 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 116 FOLLOWER]: Advancing to term 117
I20260201 21:07:47.671749 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.671870 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 117 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.672039 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 117 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.672091 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 116 FOLLOWER]: Advancing to term 117
I20260201 21:07:47.672055 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 117 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.672133 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 116 FOLLOWER]: Advancing to term 117
I20260201 21:07:47.672601 4730 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 117 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 117 because replica has last-logged OpId of term: 113 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 112 index: 103.
I20260201 21:07:47.672741 4806 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 117 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 117 because replica has last-logged OpId of term: 114 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 112 index: 103.
I20260201 21:07:47.672884 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 117 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.672962 5052 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 117 FOLLOWER]: Leader election lost for term 117. Reason: could not achieve majority
I20260201 21:07:47.679996 5053 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 117 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.680044 5053 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 117 FOLLOWER]: Advancing to term 118
I20260201 21:07:47.680492 5053 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.680605 5053 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 118 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:47.680727 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 118 candidate_status { last_received { term: 113 index: 104 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.680727 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 118 candidate_status { last_received { term: 113 index: 104 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:47.680830 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 117 FOLLOWER]: Advancing to term 118
I20260201 21:07:47.680836 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 117 FOLLOWER]: Advancing to term 118
I20260201 21:07:47.681470 4806 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 118 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for term 118 because replica has last-logged OpId of term: 114 index: 104, which is greater than that of the candidate, which has last-logged OpId of term: 113 index: 104.
I20260201 21:07:47.681456 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 118 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 118.
I20260201 21:07:47.681663 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 118 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:47.681797 5053 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 FOLLOWER]: Leader election won for term 118
I20260201 21:07:47.681850 5053 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.681895 5053 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 113.104, Last appended by leader: 104, Current term: 118, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.682337 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 114 to 118, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 118 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:47.748049 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 118 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:47.748109 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 118 FOLLOWER]: Advancing to term 119
I20260201 21:07:47.748637 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.748757 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 119 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.748893 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 119 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:47.748893 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 119 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.748978 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 118 FOLLOWER]: Advancing to term 119
I20260201 21:07:47.749464 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 119 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 119.
I20260201 21:07:47.749608 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 119 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:47.749684 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 FOLLOWER]: Leader election won for term 119
I20260201 21:07:47.749732 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:47.749774 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 114.104, Last appended by leader: 104, Current term: 119, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.750209 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 118 to 119, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 119 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:47.766633 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 118. Current term is 119. Ops: []
I20260201 21:07:47.766806 5053 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.766887 5053 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 119.105 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 103
I20260201 21:07:47.766929 5049 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 LEADER]: Stepping down as leader of term 118
I20260201 21:07:47.766988 5049 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:47.767041 5049 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 118.105, Last appended by leader: 105, Current term: 118, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.767108 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 118 FOLLOWER]: Advancing to term 119
I20260201 21:07:47.863623 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 119 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 118 index: 105. Preceding OpId from leader: term: 119 index: 105. (term mismatch)
I20260201 21:07:47.863682 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 104
I20260201 21:07:47.863696 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 118.105
I20260201 21:07:47.863709 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 119 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:47.863888 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.863946 5048 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 113.104 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 103
I20260201 21:07:47.864123 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 103
I20260201 21:07:47.864152 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 113.104
I20260201 21:07:47.864166 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 119 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:47.865003 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 119 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 112 index: 103. Preceding OpId from leader: term: 119 index: 105. (index mismatch)
I20260201 21:07:47.865231 5054 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 103, Time since last communication: 0.000s
I20260201 21:07:47.966625 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 119 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:47.966701 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 119 FOLLOWER]: Advancing to term 120
I20260201 21:07:47.967288 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.967427 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 120 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:47.967628 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 120 candidate_status { last_received { term: 119 index: 105 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:47.967720 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 119 FOLLOWER]: Advancing to term 120
I20260201 21:07:47.967628 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 120 candidate_status { last_received { term: 119 index: 105 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:47.968326 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 120.
I20260201 21:07:47.968490 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:47.968592 5052 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 FOLLOWER]: Leader election won for term 120
I20260201 21:07:47.968649 5052 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:47.968703 5052 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 119.105, Last appended by leader: 105, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.969126 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 119 to 120, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 120 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:47.982227 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 120 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 119. Current term is 120. Ops: []
I20260201 21:07:47.982457 5054 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 119.105, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260201 21:07:47.982558 5054 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 LEADER]: Stepping down as leader of term 119
I20260201 21:07:47.982589 5054 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:47.982649 5054 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 119.105, Last appended by leader: 105, Current term: 119, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:47.982721 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 119 FOLLOWER]: Advancing to term 120
I20260201 21:07:48.077461 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 120 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 119 index: 105. Preceding OpId from leader: term: 120 index: 106. (index mismatch)
I20260201 21:07:48.077706 5052 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260201 21:07:48.078596 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 120 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 119 index: 105. Preceding OpId from leader: term: 120 index: 106. (index mismatch)
I20260201 21:07:48.078778 5055 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260201 21:07:48.179642 5049 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 120 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:48.179730 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 120 FOLLOWER]: Advancing to term 121
I20260201 21:07:48.180387 5049 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.180557 5049 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 121 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:48.180714 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 121 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.180714 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 121 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:48.180954 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 121 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:48.181077 5049 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Leader election lost for term 121. Reason: could not achieve majority
I20260201 21:07:48.185940 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 120. Current term is 121. Ops: []
I20260201 21:07:48.186141 5052 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 120.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 21:07:48.186236 5052 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 LEADER]: Stepping down as leader of term 120
I20260201 21:07:48.186268 5052 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:48.186338 5052 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 120.106, Last appended by leader: 106, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.186406 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 120 FOLLOWER]: Advancing to term 121
I20260201 21:07:48.259440 5054 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 120 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:48.259549 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 120 FOLLOWER]: Advancing to term 121
I20260201 21:07:48.260103 5054 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.260241 5054 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 121 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:48.260447 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 121 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.260471 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 121 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:48.260555 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 121: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:48.261075 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 121 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 121.
I20260201 21:07:48.261238 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 121 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:48.261332 5054 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 FOLLOWER]: Leader election won for term 121
I20260201 21:07:48.261401 5054 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:48.261462 5054 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 120.106, Last appended by leader: 106, Current term: 121, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.261871 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 120 to 121, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 121 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:48.299516 5049 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:48.299564 5049 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 121 FOLLOWER]: Advancing to term 122
I20260201 21:07:48.300040 5049 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.300151 5049 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 122 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:48.300287 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 122 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:48.300287 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 122 candidate_status { last_received { term: 120 index: 106 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.300374 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 121 FOLLOWER]: Advancing to term 122
I20260201 21:07:48.300814 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 122.
I20260201 21:07:48.300959 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 122 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:48.301036 5049 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 FOLLOWER]: Leader election won for term 122
I20260201 21:07:48.301169 5049 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:48.301216 5049 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 120.106, Last appended by leader: 106, Current term: 122, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.301715 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 121 to 122, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 122 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:48.346104 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 122 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 121. Current term is 122. Ops: []
I20260201 21:07:48.346268 5054 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 21:07:48.346380 5054 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 LEADER]: Stepping down as leader of term 121
I20260201 21:07:48.346414 5054 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:48.346472 5054 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 121.107, Last appended by leader: 107, Current term: 121, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.346535 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 121 FOLLOWER]: Advancing to term 122
I20260201 21:07:48.380204 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 122 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 120 index: 106. Preceding OpId from leader: term: 122 index: 107. (index mismatch)
I20260201 21:07:48.380410 5049 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 21:07:48.381263 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 122 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 121 index: 107. Preceding OpId from leader: term: 122 index: 107. (term mismatch)
I20260201 21:07:48.381402 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 106
I20260201 21:07:48.381429 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 121.107
I20260201 21:07:48.381451 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 122 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:48.381721 5056 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260201 21:07:48.481894 5052 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 122 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:48.481976 5052 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 122 FOLLOWER]: Advancing to term 123
I20260201 21:07:48.482585 5052 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.482722 5052 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 123 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:48.482964 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 123 candidate_status { last_received { term: 122 index: 107 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:48.483026 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 123 candidate_status { last_received { term: 122 index: 107 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:48.483067 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 122 FOLLOWER]: Advancing to term 123
I20260201 21:07:48.483590 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 123 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 123.
I20260201 21:07:48.483753 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 123 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:48.483852 5052 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 FOLLOWER]: Leader election won for term 123
I20260201 21:07:48.483920 5052 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:48.483973 5052 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 122.107, Last appended by leader: 107, Current term: 123, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.484375 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 122 to 123, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 123 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:48.493259 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 123 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 122. Current term is 123. Ops: []
I20260201 21:07:48.493454 5057 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 122.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260201 21:07:48.493535 5057 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 LEADER]: Stepping down as leader of term 122
I20260201 21:07:48.493563 5057 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:48.493623 5057 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 122.107, Last appended by leader: 107, Current term: 122, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.493700 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 122 FOLLOWER]: Advancing to term 123
I20260201 21:07:48.575870 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 123 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 122 index: 107. Preceding OpId from leader: term: 123 index: 108. (index mismatch)
I20260201 21:07:48.576042 5052 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260201 21:07:48.576987 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 123 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 122 index: 107. Preceding OpId from leader: term: 123 index: 108. (index mismatch)
I20260201 21:07:48.577186 5055 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260201 21:07:48.661979 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:48.678145 5054 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 123 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:48.678192 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 123 FOLLOWER]: Advancing to term 124
I20260201 21:07:48.678771 5054 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.678912 5054 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 124 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:48.679061 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 124 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:48.679061 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 124 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.679266 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 124 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:48.679360 5054 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Leader election lost for term 124. Reason: could not achieve majority
I20260201 21:07:48.691238 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 123. Current term is 124. Ops: []
I20260201 21:07:48.691478 5058 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 123.108, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260201 21:07:48.691581 5058 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 LEADER]: Stepping down as leader of term 123
I20260201 21:07:48.691617 5058 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:48.691681 5058 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 123.108, Last appended by leader: 108, Current term: 123, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.691761 5058 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 123 FOLLOWER]: Advancing to term 124
I20260201 21:07:48.778000 5057 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 123 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:48.778064 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 123 FOLLOWER]: Advancing to term 124
I20260201 21:07:48.778604 5057 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.778729 5057 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 124 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:48.778900 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 124 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.778901 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 124 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:48.779011 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 124: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:48.779546 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 124.
I20260201 21:07:48.779688 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 124 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:48.779763 5057 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 FOLLOWER]: Leader election won for term 124
I20260201 21:07:48.779817 5057 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:48.779863 5057 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 123.108, Last appended by leader: 108, Current term: 124, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.780231 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 123 to 124, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 124 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:48.795871 5054 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:48.795914 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 124 FOLLOWER]: Advancing to term 125
I20260201 21:07:48.796353 5054 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.796454 5054 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 125 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:48.796604 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 125 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:48.796615 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 125 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:48.796669 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 124 FOLLOWER]: Advancing to term 125
I20260201 21:07:48.797130 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 125 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 125.
I20260201 21:07:48.797295 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 125 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:48.797369 5054 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 FOLLOWER]: Leader election won for term 125
I20260201 21:07:48.797430 5054 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:48.797477 5054 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 123.108, Last appended by leader: 108, Current term: 125, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.797830 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 124 to 125, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 125 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:48.870380 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 124. Current term is 125. Ops: []
I20260201 21:07:48.870563 5057 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260201 21:07:48.870622 5057 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 125.109 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 108
I20260201 21:07:48.870640 5057 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 LEADER]: Stepping down as leader of term 124
I20260201 21:07:48.870666 5057 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:48.870708 5057 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 124.109, Last appended by leader: 109, Current term: 124, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.870769 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 124 FOLLOWER]: Advancing to term 125
I20260201 21:07:48.917519 5058 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 125 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:48.917579 5058 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 125 FOLLOWER]: Advancing to term 126
I20260201 21:07:48.918058 5058 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.918165 5058 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 126 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:48.918349 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 126 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:48.918401 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 125 FOLLOWER]: Advancing to term 126
I20260201 21:07:48.918365 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 126 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:48.918886 4730 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 126 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 126 because replica has last-logged OpId of term: 124 index: 109, which is greater than that of the candidate, which has last-logged OpId of term: 123 index: 108.
I20260201 21:07:48.919029 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 126 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:48.919090 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 126 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 125. Current term is 126. Ops: []
I20260201 21:07:48.919126 5058 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 126 FOLLOWER]: Leader election lost for term 126. Reason: could not achieve majority
I20260201 21:07:48.919286 5054 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260201 21:07:48.919346 5054 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 124.109 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 108
I20260201 21:07:48.919384 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 LEADER]: Stepping down as leader of term 125
I20260201 21:07:48.919416 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:48.919461 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 125.109, Last appended by leader: 109, Current term: 125, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:48.919533 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 125 FOLLOWER]: Advancing to term 126
I20260201 21:07:49.064599 5058 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 126 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:49.064692 5058 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 126 FOLLOWER]: Advancing to term 127
I20260201 21:07:49.065358 5058 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.065611 5058 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 127 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:49.065706 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 127 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:49.065706 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 127 candidate_status { last_received { term: 123 index: 108 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:49.065819 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 126 FOLLOWER]: Advancing to term 127
I20260201 21:07:49.065830 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 126 FOLLOWER]: Advancing to term 127
I20260201 21:07:49.066448 4730 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 127 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 127 because replica has last-logged OpId of term: 124 index: 109, which is greater than that of the candidate, which has last-logged OpId of term: 123 index: 108.
I20260201 21:07:49.066448 4806 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 127 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 for term 127 because replica has last-logged OpId of term: 125 index: 109, which is greater than that of the candidate, which has last-logged OpId of term: 123 index: 108.
I20260201 21:07:49.066665 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 127 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:49.066741 5058 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 127 FOLLOWER]: Leader election lost for term 127. Reason: could not achieve majority
I20260201 21:07:49.178618 5057 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 127 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:49.178696 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 127 FOLLOWER]: Advancing to term 128
I20260201 21:07:49.179317 5057 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.179476 5057 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 128 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:49.179665 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 128 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:49.179730 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 127 FOLLOWER]: Advancing to term 128
I20260201 21:07:49.179668 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 128 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:49.179769 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 127 FOLLOWER]: Advancing to term 128
I20260201 21:07:49.180286 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 128.
I20260201 21:07:49.180290 4806 raft_consensus.cc:2410] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 128 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 for term 128 because replica has last-logged OpId of term: 125 index: 109, which is greater than that of the candidate, which has last-logged OpId of term: 124 index: 109.
I20260201 21:07:49.180472 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:49.180553 5057 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 FOLLOWER]: Leader election won for term 128
I20260201 21:07:49.180605 5057 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:49.180655 5057 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 124.109, Last appended by leader: 109, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.181053 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 125 to 128, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 128 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:49.192560 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 128 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:49.192606 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 128 FOLLOWER]: Advancing to term 129
I20260201 21:07:49.193050 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.193174 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 129 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:49.193295 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 129 candidate_status { last_received { term: 125 index: 109 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:49.193336 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 129 candidate_status { last_received { term: 125 index: 109 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:49.193351 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 128 FOLLOWER]: Advancing to term 129
I20260201 21:07:49.193852 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 129 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 129.
I20260201 21:07:49.194023 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 129 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:49.194104 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 FOLLOWER]: Leader election won for term 129
I20260201 21:07:49.194157 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:49.194206 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 125.109, Last appended by leader: 109, Current term: 129, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.194566 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 128 to 129, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 129 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:49.279089 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 129 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 123 index: 108. Preceding OpId from leader: term: 129 index: 110. (index mismatch)
I20260201 21:07:49.279274 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 108, Time since last communication: 0.000s
I20260201 21:07:49.280040 4730 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 LEADER]: Stepping down as leader of term 128
I20260201 21:07:49.280086 4730 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:49.280138 4730 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 128.110, Last appended by leader: 110, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.280166 4882 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 129 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 128. Current term is 129. Ops: []
I20260201 21:07:49.280197 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 128 FOLLOWER]: Advancing to term 129
I20260201 21:07:49.280907 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 129 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 128 index: 110. Preceding OpId from leader: term: 129 index: 110. (term mismatch)
I20260201 21:07:49.280941 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 109
I20260201 21:07:49.280952 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 128.110
I20260201 21:07:49.280963 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 129 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:49.281167 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 108, Time since last communication: 0.000s
I20260201 21:07:49.281237 5048 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 124.109 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 108
I20260201 21:07:49.281404 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 108
I20260201 21:07:49.281453 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 124.109
I20260201 21:07:49.281466 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 129 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:49.506541 5057 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 129 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:49.506618 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 129 FOLLOWER]: Advancing to term 130
I20260201 21:07:49.507197 5057 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.507339 5057 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 130 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:49.507493 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 130 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:49.507493 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 130 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:49.507719 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 130 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:49.507812 5057 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Leader election lost for term 130. Reason: could not achieve majority
I20260201 21:07:49.519636 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 129. Current term is 130. Ops: []
I20260201 21:07:49.519843 5054 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 129.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260201 21:07:49.519930 5054 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 LEADER]: Stepping down as leader of term 129
I20260201 21:07:49.519964 5054 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:49.520020 5054 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 129.110, Last appended by leader: 110, Current term: 129, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.520084 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 129 FOLLOWER]: Advancing to term 130
I20260201 21:07:49.554844 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 129 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:49.554894 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 129 FOLLOWER]: Advancing to term 130
I20260201 21:07:49.555469 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.555598 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 130 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:49.555725 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 130 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:49.555760 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 130 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:49.555817 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 130: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:49.556262 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 130.
I20260201 21:07:49.556406 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 130 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:49.556491 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 FOLLOWER]: Leader election won for term 130
I20260201 21:07:49.556551 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:49.556595 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 129.110, Last appended by leader: 110, Current term: 130, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.556964 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 129 to 130, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 130 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:49.615254 5057 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:49.615309 5057 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 130 FOLLOWER]: Advancing to term 131
I20260201 21:07:49.615808 5057 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.615958 5057 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 131 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:49.616046 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 131 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:49.616106 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 130 FOLLOWER]: Advancing to term 131
I20260201 21:07:49.616050 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 131 candidate_status { last_received { term: 129 index: 110 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:49.616626 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 131.
I20260201 21:07:49.616761 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 131 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:49.616851 5057 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 FOLLOWER]: Leader election won for term 131
I20260201 21:07:49.616904 5057 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:49.616950 5057 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 129.110, Last appended by leader: 110, Current term: 131, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.617348 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 130 to 131, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 131 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:49.644429 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 131 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 130. Current term is 131. Ops: []
I20260201 21:07:49.644652 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260201 21:07:49.644733 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 LEADER]: Stepping down as leader of term 130
I20260201 21:07:49.644762 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:49.644820 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 130.111, Last appended by leader: 111, Current term: 130, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.644883 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 130 FOLLOWER]: Advancing to term 131
I20260201 21:07:49.662164 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:49.740957 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 131 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 130 index: 111. Preceding OpId from leader: term: 131 index: 111. (term mismatch)
I20260201 21:07:49.740957 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 131 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 129 index: 110. Preceding OpId from leader: term: 131 index: 111. (index mismatch)
I20260201 21:07:49.741037 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 110
I20260201 21:07:49.741056 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 130.111
I20260201 21:07:49.741078 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 131 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:49.741220 5049 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260201 21:07:49.741336 5057 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260201 21:07:49.842695 5054 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 131 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:49.842778 5054 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 131 FOLLOWER]: Advancing to term 132
I20260201 21:07:49.843382 5054 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.843540 5054 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 132 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:49.843683 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 132 candidate_status { last_received { term: 131 index: 111 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:49.843683 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 132 candidate_status { last_received { term: 131 index: 111 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:49.843792 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 131 FOLLOWER]: Advancing to term 132
I20260201 21:07:49.844393 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 132.
I20260201 21:07:49.844564 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:49.844660 5054 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 FOLLOWER]: Leader election won for term 132
I20260201 21:07:49.844728 5054 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:49.844830 5054 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 131.111, Last appended by leader: 111, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.845275 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 131 to 132, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 132 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:49.848201 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 131. Current term is 132. Ops: []
I20260201 21:07:49.848381 5057 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 131.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260201 21:07:49.848459 5057 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 132.112 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 111
I20260201 21:07:49.848500 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 LEADER]: Stepping down as leader of term 131
I20260201 21:07:49.848551 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:49.848610 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 131.111, Last appended by leader: 111, Current term: 131, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:49.848690 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 131 FOLLOWER]: Advancing to term 132
I20260201 21:07:49.920437 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 132 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 131 index: 111. Preceding OpId from leader: term: 132 index: 112. (index mismatch)
I20260201 21:07:49.920673 5054 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260201 21:07:49.921525 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 132 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 131 index: 111. Preceding OpId from leader: term: 132 index: 112. (index mismatch)
I20260201 21:07:49.921705 5054 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260201 21:07:50.140712 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 132 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:50.140792 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 132 FOLLOWER]: Advancing to term 133
I20260201 21:07:50.141463 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.141630 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 133 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:50.141786 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 133 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:50.141793 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 133 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.142071 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 133 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:50.142160 5060 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Leader election lost for term 133. Reason: could not achieve majority
I20260201 21:07:50.154315 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 132. Current term is 133. Ops: []
I20260201 21:07:50.154490 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 132.112, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260201 21:07:50.154573 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 LEADER]: Stepping down as leader of term 132
I20260201 21:07:50.154603 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:50.154654 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 132.112, Last appended by leader: 112, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.154708 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 132 FOLLOWER]: Advancing to term 133
I20260201 21:07:50.195077 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 132 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:50.195127 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 132 FOLLOWER]: Advancing to term 133
I20260201 21:07:50.195659 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.195787 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 133 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:50.195921 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 133 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:50.195977 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 133: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:50.195931 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 133 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.196437 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 133.
I20260201 21:07:50.196604 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:50.196688 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 FOLLOWER]: Leader election won for term 133
I20260201 21:07:50.196790 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:50.196842 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 132.112, Last appended by leader: 112, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.197233 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 132 to 133, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 133 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:50.273577 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:50.273638 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 133 FOLLOWER]: Advancing to term 134
I20260201 21:07:50.274135 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.274281 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 134 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:50.274473 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 134 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:50.274472 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 134 candidate_status { last_received { term: 132 index: 112 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.274582 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 133 FOLLOWER]: Advancing to term 134
I20260201 21:07:50.275084 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 134.
I20260201 21:07:50.275243 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:50.275327 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 FOLLOWER]: Leader election won for term 134
I20260201 21:07:50.275378 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:50.275430 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 132.112, Last appended by leader: 112, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.275810 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 133 to 134, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 134 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:50.278949 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 134 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 133. Current term is 134. Ops: []
I20260201 21:07:50.279121 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260201 21:07:50.279213 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 LEADER]: Stepping down as leader of term 133
I20260201 21:07:50.279245 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:50.279318 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 133.113, Last appended by leader: 113, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.279381 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 133 FOLLOWER]: Advancing to term 134
I20260201 21:07:50.358175 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 134 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 133 index: 113. Preceding OpId from leader: term: 134 index: 113. (term mismatch)
I20260201 21:07:50.358228 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 112
I20260201 21:07:50.358242 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 133.113
I20260201 21:07:50.358253 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 134 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:50.358475 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260201 21:07:50.359253 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 134 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 132 index: 112. Preceding OpId from leader: term: 134 index: 113. (index mismatch)
I20260201 21:07:50.359463 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260201 21:07:50.633852 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 134 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:50.633935 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 134 FOLLOWER]: Advancing to term 135
I20260201 21:07:50.634595 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.634730 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 135 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:50.634909 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 135 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.634913 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 135 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:50.635128 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 135 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:50.635231 5059 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Leader election lost for term 135. Reason: could not achieve majority
I20260201 21:07:50.648547 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 134. Current term is 135. Ops: []
I20260201 21:07:50.648772 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 134.113, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260201 21:07:50.648869 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 LEADER]: Stepping down as leader of term 134
I20260201 21:07:50.648902 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:50.648957 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 134.113, Last appended by leader: 113, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.649030 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 134 FOLLOWER]: Advancing to term 135
I20260201 21:07:50.662333 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:50.716053 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 134 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:50.716109 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 134 FOLLOWER]: Advancing to term 135
I20260201 21:07:50.716676 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.716789 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 135 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:50.716934 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 135 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:50.716934 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 135 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:50.717031 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 135: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:50.717523 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 135 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 135.
I20260201 21:07:50.717681 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 135 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:50.717770 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 FOLLOWER]: Leader election won for term 135
I20260201 21:07:50.717876 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:50.717933 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 134.113, Last appended by leader: 113, Current term: 135, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.718327 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 134 to 135, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 135 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:50.775059 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:50.775120 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 135 FOLLOWER]: Advancing to term 136
I20260201 21:07:50.775609 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.775719 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 136 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:50.775884 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 136 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:50.775884 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 136 candidate_status { last_received { term: 134 index: 113 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.775980 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 135 FOLLOWER]: Advancing to term 136
I20260201 21:07:50.776448 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 136.
I20260201 21:07:50.776605 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:50.776683 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 FOLLOWER]: Leader election won for term 136
I20260201 21:07:50.776731 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:50.776857 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 134.113, Last appended by leader: 113, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.777261 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 135 to 136, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 136 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:50.804668 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 136 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 135. Current term is 136. Ops: []
I20260201 21:07:50.804881 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260201 21:07:50.804963 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 LEADER]: Stepping down as leader of term 135
I20260201 21:07:50.804980 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:50.805024 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 135.114, Last appended by leader: 114, Current term: 135, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.805091 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 135 FOLLOWER]: Advancing to term 136
I20260201 21:07:50.853600 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 136 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 134 index: 113. Preceding OpId from leader: term: 136 index: 114. (index mismatch)
I20260201 21:07:50.853820 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260201 21:07:50.854600 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 136 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 135 index: 114. Preceding OpId from leader: term: 136 index: 114. (term mismatch)
I20260201 21:07:50.854661 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 113
I20260201 21:07:50.854681 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 135.114
I20260201 21:07:50.854697 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 136 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:50.854856 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260201 21:07:50.955493 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 136 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:50.955610 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 136 FOLLOWER]: Advancing to term 137
I20260201 21:07:50.956257 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.956413 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 137 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:50.956609 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 137 candidate_status { last_received { term: 136 index: 114 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:50.956612 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 137 candidate_status { last_received { term: 136 index: 114 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:50.956740 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 136 FOLLOWER]: Advancing to term 137
I20260201 21:07:50.957335 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 137 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 137.
I20260201 21:07:50.957507 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 137 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:50.957592 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 FOLLOWER]: Leader election won for term 137
I20260201 21:07:50.957648 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:50.957718 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 136.114, Last appended by leader: 114, Current term: 137, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.958160 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 136 to 137, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 137 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:50.960721 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 136. Current term is 137. Ops: []
I20260201 21:07:50.960896 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 136.114, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260201 21:07:50.960958 5059 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 137.115 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 114
I20260201 21:07:50.960994 5061 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 LEADER]: Stepping down as leader of term 136
I20260201 21:07:50.961035 5061 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:50.961088 5061 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 136.114, Last appended by leader: 114, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:50.961198 5061 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 136 FOLLOWER]: Advancing to term 137
I20260201 21:07:51.052837 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 137 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 136 index: 114. Preceding OpId from leader: term: 137 index: 115. (index mismatch)
I20260201 21:07:51.053073 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260201 21:07:51.054091 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 137 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 136 index: 114. Preceding OpId from leader: term: 137 index: 115. (index mismatch)
I20260201 21:07:51.054307 5064 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260201 21:07:51.154868 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 137 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:51.154940 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 137 FOLLOWER]: Advancing to term 138
I20260201 21:07:51.155556 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.155685 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 138 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:51.155839 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 138 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:51.155839 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 138 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:51.156059 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 138 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:51.156191 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Leader election lost for term 138. Reason: could not achieve majority
I20260201 21:07:51.160084 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 137. Current term is 138. Ops: []
I20260201 21:07:51.160267 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 137.115, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260201 21:07:51.160357 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 LEADER]: Stepping down as leader of term 137
I20260201 21:07:51.160380 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:51.160427 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 137.115, Last appended by leader: 115, Current term: 137, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.160490 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 137 FOLLOWER]: Advancing to term 138
I20260201 21:07:51.248148 5061 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 137 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:51.248240 5061 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 137 FOLLOWER]: Advancing to term 138
I20260201 21:07:51.248883 5061 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.249030 5061 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 138 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:51.249238 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 138 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:51.249238 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 138 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:51.249349 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 138: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:51.249889 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 138.
I20260201 21:07:51.250041 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:51.250134 5061 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 FOLLOWER]: Leader election won for term 138
I20260201 21:07:51.250186 5061 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:51.250224 5061 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 137.115, Last appended by leader: 115, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.250684 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 137 to 138, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 138 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:51.269819 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:51.269865 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 138 FOLLOWER]: Advancing to term 139
I20260201 21:07:51.270282 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.270378 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 139 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:51.270529 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 139 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:51.270540 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 139 candidate_status { last_received { term: 137 index: 115 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:51.270593 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 138 FOLLOWER]: Advancing to term 139
I20260201 21:07:51.271059 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 139 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 139.
I20260201 21:07:51.271191 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 139 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:51.271271 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 FOLLOWER]: Leader election won for term 139
I20260201 21:07:51.271325 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:51.271353 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 137.115, Last appended by leader: 115, Current term: 139, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.271746 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 138 to 139, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 139 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:51.345399 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 138. Current term is 139. Ops: []
I20260201 21:07:51.345607 5061 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260201 21:07:51.345692 5061 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 139.116 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 115
I20260201 21:07:51.345728 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 LEADER]: Stepping down as leader of term 138
I20260201 21:07:51.345775 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:51.345827 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 138.116, Last appended by leader: 116, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.345889 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 138 FOLLOWER]: Advancing to term 139
I20260201 21:07:51.363044 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 139 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 137 index: 115. Preceding OpId from leader: term: 139 index: 116. (index mismatch)
I20260201 21:07:51.363245 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260201 21:07:51.364082 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 139 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 138 index: 116. Preceding OpId from leader: term: 139 index: 116. (term mismatch)
I20260201 21:07:51.364130 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 115
I20260201 21:07:51.364148 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 138.116
I20260201 21:07:51.364164 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 139 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:51.364310 5065 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260201 21:07:51.662528 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:51.688774 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 139 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:51.688836 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 139 FOLLOWER]: Advancing to term 140
I20260201 21:07:51.689489 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.689607 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 140 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:51.689759 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 140 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:51.689761 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 140 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:51.689975 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 140 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:51.690069 5059 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Leader election lost for term 140. Reason: could not achieve majority
I20260201 21:07:51.706269 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 139. Current term is 140. Ops: []
I20260201 21:07:51.706458 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 139.116, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260201 21:07:51.706557 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 LEADER]: Stepping down as leader of term 139
I20260201 21:07:51.706588 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:51.706636 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 139.116, Last appended by leader: 116, Current term: 139, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.706713 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 139 FOLLOWER]: Advancing to term 140
I20260201 21:07:51.748531 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 139 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:51.748592 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 139 FOLLOWER]: Advancing to term 140
I20260201 21:07:51.749125 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.749289 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 140 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:51.749429 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 140 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:51.749429 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 140 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:51.749523 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 140: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:51.750005 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 140.
I20260201 21:07:51.750150 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:51.750241 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 FOLLOWER]: Leader election won for term 140
I20260201 21:07:51.750346 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:51.750398 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 139.116, Last appended by leader: 116, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.750769 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 139 to 140, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 140 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:51.804569 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:51.804620 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 140 FOLLOWER]: Advancing to term 141
I20260201 21:07:51.805059 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.805217 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 141 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:51.805362 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 141 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:51.805375 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 141 candidate_status { last_received { term: 139 index: 116 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:51.805449 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 140 FOLLOWER]: Advancing to term 141
I20260201 21:07:51.805902 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 141.
I20260201 21:07:51.806041 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:51.806116 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 FOLLOWER]: Leader election won for term 141
I20260201 21:07:51.806159 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:51.806190 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 139.116, Last appended by leader: 116, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.806560 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 140 to 141, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 141 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:51.850898 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 140. Current term is 141. Ops: []
I20260201 21:07:51.851081 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260201 21:07:51.851151 5060 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 141.117 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 116
I20260201 21:07:51.851192 5066 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 LEADER]: Stepping down as leader of term 140
I20260201 21:07:51.851246 5066 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:51.851312 5066 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 140.117, Last appended by leader: 117, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:51.851382 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 140 FOLLOWER]: Advancing to term 141
I20260201 21:07:51.902886 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 141 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 140 index: 117. Preceding OpId from leader: term: 141 index: 117. (term mismatch)
I20260201 21:07:51.902936 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 116
I20260201 21:07:51.902949 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 140.117
I20260201 21:07:51.902961 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 141 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:51.903139 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260201 21:07:51.903949 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 141 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 139 index: 116. Preceding OpId from leader: term: 141 index: 117. (index mismatch)
I20260201 21:07:51.904142 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260201 21:07:52.005319 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 141 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:52.005389 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 141 FOLLOWER]: Advancing to term 142
I20260201 21:07:52.006747 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.006883 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 142 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.007033 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 142 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.007051 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 142 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.007273 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 142 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:52.007360 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Leader election lost for term 142. Reason: could not achieve majority
I20260201 21:07:52.009287 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 141. Current term is 142. Ops: []
I20260201 21:07:52.009478 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 141.117, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260201 21:07:52.009577 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 LEADER]: Stepping down as leader of term 141
I20260201 21:07:52.009609 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:52.009665 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 141.117, Last appended by leader: 117, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.009737 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 141 FOLLOWER]: Advancing to term 142
I20260201 21:07:52.087019 5066 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 141 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:52.087092 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 141 FOLLOWER]: Advancing to term 142
I20260201 21:07:52.087638 5066 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.087770 5066 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 142 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:52.087905 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 142 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.087944 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 142 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.087975 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 142: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:52.088483 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 142 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 142.
I20260201 21:07:52.088644 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 142 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:52.088718 5066 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 FOLLOWER]: Leader election won for term 142
I20260201 21:07:52.088768 5066 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:52.088827 5066 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 141.117, Last appended by leader: 117, Current term: 142, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.089213 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 141 to 142, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 142 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:52.114737 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:52.114789 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 142 FOLLOWER]: Advancing to term 143
I20260201 21:07:52.115253 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.115353 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 143 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.115502 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 143 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.115514 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 143 candidate_status { last_received { term: 141 index: 117 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.115592 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 142 FOLLOWER]: Advancing to term 143
I20260201 21:07:52.116106 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 143.
I20260201 21:07:52.116255 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:52.116328 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 FOLLOWER]: Leader election won for term 143
I20260201 21:07:52.116389 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.116434 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 141.117, Last appended by leader: 117, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.116799 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 142 to 143, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 143 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:52.170686 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 143 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 142. Current term is 143. Ops: []
I20260201 21:07:52.170882 5066 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260201 21:07:52.170972 5066 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 LEADER]: Stepping down as leader of term 142
I20260201 21:07:52.171006 5066 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:52.171058 5066 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 142.118, Last appended by leader: 118, Current term: 142, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.171121 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 142 FOLLOWER]: Advancing to term 143
I20260201 21:07:52.196102 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 143 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 142 index: 118. Preceding OpId from leader: term: 143 index: 118. (term mismatch)
I20260201 21:07:52.196147 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 117
I20260201 21:07:52.196161 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 142.118
I20260201 21:07:52.196174 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 143 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:52.196358 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260201 21:07:52.197222 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 143 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 141 index: 117. Preceding OpId from leader: term: 143 index: 118. (index mismatch)
I20260201 21:07:52.197466 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260201 21:07:52.298363 5067 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 143 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:52.298430 5067 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 143 FOLLOWER]: Advancing to term 144
I20260201 21:07:52.299059 5067 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.299185 5067 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 144 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.299366 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 144 candidate_status { last_received { term: 143 index: 118 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.299366 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 144 candidate_status { last_received { term: 143 index: 118 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.299490 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 143 FOLLOWER]: Advancing to term 144
I20260201 21:07:52.300040 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 144 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 144.
I20260201 21:07:52.300185 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 144 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:52.300264 5067 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 FOLLOWER]: Leader election won for term 144
I20260201 21:07:52.300308 5067 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:52.300341 5067 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 143.118, Last appended by leader: 118, Current term: 144, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.300699 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 143 to 144, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 144 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:52.301393 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 144 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 143. Current term is 144. Ops: []
I20260201 21:07:52.301549 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 143.118, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260201 21:07:52.301621 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 LEADER]: Stepping down as leader of term 143
I20260201 21:07:52.301649 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.301699 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 143.118, Last appended by leader: 118, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.301766 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 143 FOLLOWER]: Advancing to term 144
I20260201 21:07:52.395941 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 144 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 143 index: 118. Preceding OpId from leader: term: 144 index: 119. (index mismatch)
I20260201 21:07:52.396147 5067 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260201 21:07:52.397070 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 144 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 143 index: 118. Preceding OpId from leader: term: 144 index: 119. (index mismatch)
I20260201 21:07:52.397238 5061 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260201 21:07:52.497877 5066 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 144 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:52.497941 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 144 FOLLOWER]: Advancing to term 145
I20260201 21:07:52.498517 5066 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.498675 5066 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 145 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:52.498824 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 145 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.498824 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 145 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.499034 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:52.499109 5066 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260201 21:07:52.522064 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 144. Current term is 145. Ops: []
I20260201 21:07:52.522253 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 144.119, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260201 21:07:52.522338 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 LEADER]: Stepping down as leader of term 144
I20260201 21:07:52.522375 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:52.522428 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 144.119, Last appended by leader: 119, Current term: 144, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.522509 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 144 FOLLOWER]: Advancing to term 145
I20260201 21:07:52.576725 5065 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 144 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:52.576782 5065 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 144 FOLLOWER]: Advancing to term 145
I20260201 21:07:52.577394 5065 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.577524 5065 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 145 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.577680 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 145 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.577697 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 145 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.577739 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 145: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:52.578200 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 145 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 145.
I20260201 21:07:52.578364 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 145 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:52.578460 5065 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 FOLLOWER]: Leader election won for term 145
I20260201 21:07:52.578522 5065 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.578560 5065 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 144.119, Last appended by leader: 119, Current term: 145, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.578963 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 144 to 145, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 145 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:52.605436 5066 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:52.605485 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 145 FOLLOWER]: Advancing to term 146
I20260201 21:07:52.605944 5066 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.606053 5066 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 146 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:52.606178 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 146 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.606178 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 146 candidate_status { last_received { term: 144 index: 119 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.606259 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 145 FOLLOWER]: Advancing to term 146
I20260201 21:07:52.606710 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 146.
I20260201 21:07:52.606864 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:52.606951 5066 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 FOLLOWER]: Leader election won for term 146
I20260201 21:07:52.607003 5066 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:52.607052 5066 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 144.119, Last appended by leader: 119, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.607399 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 145 to 146, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 146 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:52.662767 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:52.673100 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 145. Current term is 146. Ops: []
I20260201 21:07:52.673379 5065 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260201 21:07:52.673475 5065 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 146.120 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 119
I20260201 21:07:52.673509 5065 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 LEADER]: Stepping down as leader of term 145
I20260201 21:07:52.673539 5065 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.673592 5065 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 145.120, Last appended by leader: 120, Current term: 145, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.673648 5065 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 145 FOLLOWER]: Advancing to term 146
I20260201 21:07:52.706058 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 146 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 144 index: 119. Preceding OpId from leader: term: 146 index: 120. (index mismatch)
I20260201 21:07:52.706319 5066 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260201 21:07:52.707211 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 146 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 145 index: 120. Preceding OpId from leader: term: 146 index: 120. (term mismatch)
I20260201 21:07:52.707268 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 119
I20260201 21:07:52.707291 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 145.120
I20260201 21:07:52.707309 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 146 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:52.707449 5068 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260201 21:07:52.808099 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 146 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:52.808164 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 146 FOLLOWER]: Advancing to term 147
I20260201 21:07:52.808797 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.808928 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 147 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.809098 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 147 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.809105 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 147 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.809345 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 147 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:52.809443 5059 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Leader election lost for term 147. Reason: could not achieve majority
I20260201 21:07:52.814946 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 146. Current term is 147. Ops: []
I20260201 21:07:52.815145 5066 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 146.120, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260201 21:07:52.815232 5066 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 LEADER]: Stepping down as leader of term 146
I20260201 21:07:52.815284 5066 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:52.815328 5066 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 146.120, Last appended by leader: 120, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.815392 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 146 FOLLOWER]: Advancing to term 147
I20260201 21:07:52.899121 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 146 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:52.899184 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 146 FOLLOWER]: Advancing to term 147
I20260201 21:07:52.899725 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.899847 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 147 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.900002 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 147 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.900007 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 147 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:52.900091 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 147: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:52.900583 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 147 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 147.
I20260201 21:07:52.900738 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 147 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:52.900823 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 FOLLOWER]: Leader election won for term 147
I20260201 21:07:52.900882 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.900938 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 146.120, Last appended by leader: 120, Current term: 147, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.901381 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 146 to 147, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 147 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:52.923892 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:52.923941 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 147 FOLLOWER]: Advancing to term 148
I20260201 21:07:52.924417 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.924597 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 148 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:52.924666 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 148 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:52.924671 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 148 candidate_status { last_received { term: 146 index: 120 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:52.924763 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 147 FOLLOWER]: Advancing to term 148
I20260201 21:07:52.925285 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 148 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 148.
I20260201 21:07:52.925428 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 148 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:52.925514 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 FOLLOWER]: Leader election won for term 148
I20260201 21:07:52.925578 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:52.925659 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 146.120, Last appended by leader: 120, Current term: 148, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.926030 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 147 to 148, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 148 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:52.998703 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 148 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 147. Current term is 148. Ops: []
I20260201 21:07:52.998914 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260201 21:07:52.999008 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 LEADER]: Stepping down as leader of term 147
I20260201 21:07:52.999042 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:52.999094 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 147.121, Last appended by leader: 121, Current term: 147, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:52.999161 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 147 FOLLOWER]: Advancing to term 148
I20260201 21:07:53.035534 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 148 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 146 index: 120. Preceding OpId from leader: term: 148 index: 121. (index mismatch)
I20260201 21:07:53.035737 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260201 21:07:53.036623 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 148 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 147 index: 121. Preceding OpId from leader: term: 148 index: 121. (term mismatch)
I20260201 21:07:53.036675 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 120
I20260201 21:07:53.036692 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 147.121
I20260201 21:07:53.036708 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 148 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:53.036850 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260201 21:07:53.137501 5066 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 148 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:53.137570 5066 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 148 FOLLOWER]: Advancing to term 149
I20260201 21:07:53.138144 5066 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.138283 5066 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 149 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:53.138466 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 149 candidate_status { last_received { term: 148 index: 121 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:53.138466 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 149 candidate_status { last_received { term: 148 index: 121 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:53.138540 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 148 FOLLOWER]: Advancing to term 149
I20260201 21:07:53.139011 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 149.
I20260201 21:07:53.139173 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:53.139261 5066 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 FOLLOWER]: Leader election won for term 149
I20260201 21:07:53.139317 5066 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:53.139367 5066 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 148.121, Last appended by leader: 121, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.139753 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 148 to 149, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 149 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:53.152128 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 149 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 148. Current term is 149. Ops: []
I20260201 21:07:53.152323 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 148.121, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260201 21:07:53.152495 5061 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 LEADER]: Stepping down as leader of term 148
I20260201 21:07:53.152537 5061 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:53.152580 5061 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 148.121, Last appended by leader: 121, Current term: 148, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.152664 5061 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 148 FOLLOWER]: Advancing to term 149
I20260201 21:07:53.220345 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 149 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 148 index: 121. Preceding OpId from leader: term: 149 index: 122. (index mismatch)
I20260201 21:07:53.220571 5066 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260201 21:07:53.221578 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 149 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 148 index: 121. Preceding OpId from leader: term: 149 index: 122. (index mismatch)
I20260201 21:07:53.221753 5066 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260201 21:07:53.321882 5065 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 149 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:53.321970 5065 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 149 FOLLOWER]: Advancing to term 150
I20260201 21:07:53.322605 5065 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.322752 5065 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 150 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:53.322927 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 150 candidate_status { last_received { term: 149 index: 122 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:53.322928 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 150 candidate_status { last_received { term: 149 index: 122 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:53.323016 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 149 FOLLOWER]: Advancing to term 150
I20260201 21:07:53.323593 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 150 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 150.
I20260201 21:07:53.323752 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 150 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:53.323846 5065 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 FOLLOWER]: Leader election won for term 150
I20260201 21:07:53.323905 5065 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:53.323966 5065 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 149.122, Last appended by leader: 122, Current term: 150, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.324404 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 149 to 150, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 150 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:53.329556 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 150 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 149. Current term is 150. Ops: []
I20260201 21:07:53.329752 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 149.122, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260201 21:07:53.329830 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 LEADER]: Stepping down as leader of term 149
I20260201 21:07:53.329864 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:53.329914 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 149.122, Last appended by leader: 122, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.329977 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 149 FOLLOWER]: Advancing to term 150
I20260201 21:07:53.403918 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 150 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 149 index: 122. Preceding OpId from leader: term: 150 index: 123. (index mismatch)
I20260201 21:07:53.404126 5065 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260201 21:07:53.404986 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 150 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 149 index: 122. Preceding OpId from leader: term: 150 index: 123. (index mismatch)
I20260201 21:07:53.405202 5069 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260201 21:07:53.505443 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 150 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:53.505527 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 150 FOLLOWER]: Advancing to term 151
I20260201 21:07:53.506147 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.506268 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 151 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:53.506412 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 151 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:53.506412 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 151 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:53.506618 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 151 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:53.506705 5059 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Leader election lost for term 151. Reason: could not achieve majority
I20260201 21:07:53.519030 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 150. Current term is 151. Ops: []
I20260201 21:07:53.519233 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 150.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260201 21:07:53.519323 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 LEADER]: Stepping down as leader of term 150
I20260201 21:07:53.519359 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:53.519408 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 150.123, Last appended by leader: 123, Current term: 150, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.519477 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 150 FOLLOWER]: Advancing to term 151
I20260201 21:07:53.603778 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 150 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:53.603843 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 150 FOLLOWER]: Advancing to term 151
I20260201 21:07:53.604414 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.604544 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 151 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:53.604740 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 151 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:53.604740 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 151 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:53.604842 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 151: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:53.605352 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 151 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 151.
I20260201 21:07:53.605504 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 151 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:53.605590 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 FOLLOWER]: Leader election won for term 151
I20260201 21:07:53.605657 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:53.605715 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 150.123, Last appended by leader: 123, Current term: 151, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.606078 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 150 to 151, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 151 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:53.608019 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:53.608062 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 151 FOLLOWER]: Advancing to term 152
I20260201 21:07:53.608543 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.608652 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 152 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:53.608793 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 152 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:53.608801 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 152 candidate_status { last_received { term: 150 index: 123 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:53.608872 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 151 FOLLOWER]: Advancing to term 152
I20260201 21:07:53.609452 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 152.
I20260201 21:07:53.609624 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:53.609700 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 FOLLOWER]: Leader election won for term 152
I20260201 21:07:53.609754 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:53.609797 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 150.123, Last appended by leader: 123, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.610139 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 151 to 152, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 152 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:53.662987 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:53.689345 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 152 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 150 index: 123. Preceding OpId from leader: term: 152 index: 124. (index mismatch)
I20260201 21:07:53.689546 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260201 21:07:53.690197 4730 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 LEADER]: Stepping down as leader of term 151
I20260201 21:07:53.690253 4730 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:53.690296 4730 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 151.124, Last appended by leader: 124, Current term: 151, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.690366 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 151 FOLLOWER]: Advancing to term 152
I20260201 21:07:53.690968 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 152 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 151 index: 124. Preceding OpId from leader: term: 152 index: 124. (term mismatch)
I20260201 21:07:53.691000 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 123
I20260201 21:07:53.691013 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 151.124
I20260201 21:07:53.691025 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 152 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:53.691188 5070 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260201 21:07:53.966550 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 152 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:53.966634 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 152 FOLLOWER]: Advancing to term 153
I20260201 21:07:53.967219 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.967335 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 153 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:53.967509 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 153 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:53.967511 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 153 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:53.967743 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:53.967846 5048 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260201 21:07:53.969614 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 152. Current term is 153. Ops: []
I20260201 21:07:53.969818 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 152.124, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260201 21:07:53.969894 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 LEADER]: Stepping down as leader of term 152
I20260201 21:07:53.969919 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:53.969975 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 152.124, Last appended by leader: 124, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:53.970037 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 152 FOLLOWER]: Advancing to term 153
I20260201 21:07:54.056171 5068 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 152 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:54.056245 5068 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 152 FOLLOWER]: Advancing to term 153
I20260201 21:07:54.056912 5068 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.057046 5068 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 153 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:54.057255 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 153 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.057260 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 153 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:54.057372 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 153: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:54.057850 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 153 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 153.
I20260201 21:07:54.058010 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 153 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:54.058099 5068 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 FOLLOWER]: Leader election won for term 153
I20260201 21:07:54.058147 5068 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:54.058182 5068 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 152.124, Last appended by leader: 124, Current term: 153, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.058581 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 152 to 153, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 153 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:54.101325 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:54.101380 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 153 FOLLOWER]: Advancing to term 154
I20260201 21:07:54.101892 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.102031 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 154 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:54.102212 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 154 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.102277 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 153 FOLLOWER]: Advancing to term 154
I20260201 21:07:54.102216 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 154 candidate_status { last_received { term: 152 index: 124 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:54.102768 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 154.
I20260201 21:07:54.102928 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:54.103062 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 FOLLOWER]: Leader election won for term 154
I20260201 21:07:54.103209 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:54.103255 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 152.124, Last appended by leader: 124, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.103634 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 153 to 154, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 154 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:54.173038 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 153. Current term is 154. Ops: []
I20260201 21:07:54.173288 5068 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260201 21:07:54.173377 5068 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 154.125 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 124
I20260201 21:07:54.173413 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 LEADER]: Stepping down as leader of term 153
I20260201 21:07:54.173449 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:54.173527 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 153.125, Last appended by leader: 125, Current term: 153, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.173604 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 153 FOLLOWER]: Advancing to term 154
I20260201 21:07:54.204926 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 154 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 152 index: 124. Preceding OpId from leader: term: 154 index: 125. (index mismatch)
I20260201 21:07:54.205127 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260201 21:07:54.205961 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 154 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 153 index: 125. Preceding OpId from leader: term: 154 index: 125. (term mismatch)
I20260201 21:07:54.206010 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 124
I20260201 21:07:54.206030 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 153.125
I20260201 21:07:54.206051 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 154 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:54.206233 5072 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260201 21:07:54.511294 5068 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 154 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:54.511371 5068 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 154 FOLLOWER]: Advancing to term 155
I20260201 21:07:54.512048 5068 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.512208 5068 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 155 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:54.512396 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 155 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:54.512409 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 155 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.512624 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 155 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:54.512722 5068 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Leader election lost for term 155. Reason: could not achieve majority
I20260201 21:07:54.524878 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 154. Current term is 155. Ops: []
I20260201 21:07:54.525074 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 154.125, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260201 21:07:54.525204 5071 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 LEADER]: Stepping down as leader of term 154
I20260201 21:07:54.525259 5071 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:54.525309 5071 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 154.125, Last appended by leader: 125, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.525382 5071 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 154 FOLLOWER]: Advancing to term 155
I20260201 21:07:54.569211 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 154 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:54.569275 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 154 FOLLOWER]: Advancing to term 155
I20260201 21:07:54.569797 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.569906 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 155 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:54.570068 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 155 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:54.570070 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 155 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:54.570151 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 155: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:54.570664 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 155 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 155.
I20260201 21:07:54.570822 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 155 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:54.570896 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 FOLLOWER]: Leader election won for term 155
I20260201 21:07:54.570986 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:54.571022 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 154.125, Last appended by leader: 125, Current term: 155, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.571403 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 154 to 155, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 155 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:54.640271 5068 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:54.640347 5068 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 155 FOLLOWER]: Advancing to term 156
I20260201 21:07:54.640914 5068 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.641048 5068 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 156 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:54.641253 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 156 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:54.641310 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 155 FOLLOWER]: Advancing to term 156
I20260201 21:07:54.641261 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 156 candidate_status { last_received { term: 154 index: 125 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.641836 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 156 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 156.
I20260201 21:07:54.642014 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 156 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:54.642103 5068 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 FOLLOWER]: Leader election won for term 156
I20260201 21:07:54.642158 5068 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:54.642306 5068 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 154.125, Last appended by leader: 125, Current term: 156, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.642716 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 155 to 156, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 156 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:54.663187 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:54.682677 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 155. Current term is 156. Ops: []
I20260201 21:07:54.682893 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260201 21:07:54.682958 5059 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 156.126 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 125
I20260201 21:07:54.682999 5073 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 LEADER]: Stepping down as leader of term 155
I20260201 21:07:54.683048 5073 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:54.683099 5073 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 155.126, Last appended by leader: 126, Current term: 155, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.683174 5073 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 155 FOLLOWER]: Advancing to term 156
I20260201 21:07:54.728017 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 156 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 154 index: 125. Preceding OpId from leader: term: 156 index: 126. (index mismatch)
I20260201 21:07:54.728204 5068 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260201 21:07:54.729121 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 156 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 155 index: 126. Preceding OpId from leader: term: 156 index: 126. (term mismatch)
I20260201 21:07:54.729193 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 125
I20260201 21:07:54.729224 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 155.126
I20260201 21:07:54.729246 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 156 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:54.729400 5068 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260201 21:07:54.829432 5071 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 156 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:54.829489 5071 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 156 FOLLOWER]: Advancing to term 157
I20260201 21:07:54.830276 5071 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.830381 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 156. Current term is 157. Ops: []
I20260201 21:07:54.830469 5071 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 157 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:54.830497 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 157 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.830564 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 156.126, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260201 21:07:54.830613 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 157 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:54.830643 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 LEADER]: Stepping down as leader of term 156
I20260201 21:07:54.830664 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:54.830703 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 156.126, Last appended by leader: 126, Current term: 156, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.830732 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 157 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:54.830780 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 156 FOLLOWER]: Advancing to term 157
I20260201 21:07:54.830802 5071 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Leader election lost for term 157. Reason: could not achieve majority
I20260201 21:07:54.931051 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 156 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:54.931126 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 156 FOLLOWER]: Advancing to term 157
I20260201 21:07:54.931707 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.931845 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 157 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:54.932054 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 157 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:54.932124 4806 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 157: Already voted for candidate 053bc98be2b84a0194c5606c4c8a3cba in this term.
I20260201 21:07:54.932057 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 157 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:54.932658 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 157.
I20260201 21:07:54.932817 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 157 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:54.932900 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 FOLLOWER]: Leader election won for term 157
I20260201 21:07:54.932952 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:54.932992 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 156.126, Last appended by leader: 126, Current term: 157, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.933446 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 156 to 157, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 157 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:54.974589 5071 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:54.974644 5071 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 157 FOLLOWER]: Advancing to term 158
I20260201 21:07:54.975140 5071 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.975287 5071 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 158 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:54.975432 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 158 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:54.975431 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 158 candidate_status { last_received { term: 156 index: 126 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:54.975520 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 157 FOLLOWER]: Advancing to term 158
I20260201 21:07:54.976008 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 158 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 158.
I20260201 21:07:54.976172 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 158 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:54.976259 5071 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 FOLLOWER]: Leader election won for term 158
I20260201 21:07:54.976311 5071 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:54.976372 5071 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 156.126, Last appended by leader: 126, Current term: 158, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:54.976745 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 157 to 158, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 158 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:55.016604 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 157. Current term is 158. Ops: []
I20260201 21:07:55.016779 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260201 21:07:55.016853 5059 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 158.127 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 126
I20260201 21:07:55.016888 5073 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 LEADER]: Stepping down as leader of term 157
I20260201 21:07:55.016932 5073 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:55.016986 5073 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 157.127, Last appended by leader: 127, Current term: 157, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.017050 5073 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 157 FOLLOWER]: Advancing to term 158
I20260201 21:07:55.053016 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 158 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 156 index: 126. Preceding OpId from leader: term: 158 index: 127. (index mismatch)
I20260201 21:07:55.053248 5071 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260201 21:07:55.054082 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 158 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 157 index: 127. Preceding OpId from leader: term: 158 index: 127. (term mismatch)
I20260201 21:07:55.054136 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 126
I20260201 21:07:55.054158 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 157.127
I20260201 21:07:55.054178 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 158 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:55.054352 5071 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260201 21:07:55.154512 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 158 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:55.154605 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 158 FOLLOWER]: Advancing to term 159
I20260201 21:07:55.160857 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.161046 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 159 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:55.161243 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 159 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:55.161279 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 159 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.161463 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:55.161553 5060 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260201 21:07:55.165552 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 158. Current term is 159. Ops: []
I20260201 21:07:55.165750 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 158.127, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260201 21:07:55.165838 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 LEADER]: Stepping down as leader of term 158
I20260201 21:07:55.165868 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:55.165920 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 158.127, Last appended by leader: 127, Current term: 158, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.165993 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 158 FOLLOWER]: Advancing to term 159
I20260201 21:07:55.249464 5073 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 158 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:55.249547 5073 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 158 FOLLOWER]: Advancing to term 159
I20260201 21:07:55.250140 5073 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.250299 5073 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 159 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:55.250483 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 159 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.250490 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 159 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:55.250603 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 159: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:55.251029 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 159 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 159.
I20260201 21:07:55.251174 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 159 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:55.251268 5073 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 FOLLOWER]: Leader election won for term 159
I20260201 21:07:55.251324 5073 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:55.251374 5073 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 158.127, Last appended by leader: 127, Current term: 159, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.251772 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 158 to 159, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 159 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:55.287101 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:55.287151 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 159 FOLLOWER]: Advancing to term 160
I20260201 21:07:55.287642 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.287751 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 160 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:55.287875 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 160 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.287880 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 160 candidate_status { last_received { term: 158 index: 127 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:55.287940 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 159 FOLLOWER]: Advancing to term 160
I20260201 21:07:55.288482 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 160 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 160.
I20260201 21:07:55.288625 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 160 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:55.288702 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 FOLLOWER]: Leader election won for term 160
I20260201 21:07:55.288758 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:55.288805 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 158.127, Last appended by leader: 127, Current term: 160, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.289188 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 159 to 160, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 160 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:55.328127 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 159. Current term is 160. Ops: []
I20260201 21:07:55.328393 5073 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260201 21:07:55.328495 5073 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 160.128 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 127
I20260201 21:07:55.328547 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 LEADER]: Stepping down as leader of term 159
I20260201 21:07:55.328586 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:55.328639 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 159.128, Last appended by leader: 128, Current term: 159, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.328714 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 159 FOLLOWER]: Advancing to term 160
I20260201 21:07:55.396483 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 160 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 158 index: 127. Preceding OpId from leader: term: 160 index: 128. (index mismatch)
I20260201 21:07:55.396489 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 160 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 159 index: 128. Preceding OpId from leader: term: 160 index: 128. (term mismatch)
I20260201 21:07:55.396575 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 127
I20260201 21:07:55.396596 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 159.128
I20260201 21:07:55.396617 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 160 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:55.396759 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260201 21:07:55.396835 5068 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260201 21:07:55.498359 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 160 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:55.498426 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 160 FOLLOWER]: Advancing to term 161
I20260201 21:07:55.499011 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.499151 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 161 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:55.499336 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 161 candidate_status { last_received { term: 160 index: 128 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:55.499338 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 161 candidate_status { last_received { term: 160 index: 128 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:55.499431 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 160 FOLLOWER]: Advancing to term 161
I20260201 21:07:55.499962 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 161 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 161.
I20260201 21:07:55.500108 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 161 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:55.500182 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 FOLLOWER]: Leader election won for term 161
I20260201 21:07:55.500232 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:55.500280 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 160.128, Last appended by leader: 128, Current term: 161, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.500635 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 160 to 161, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 161 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:55.508005 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 LEADER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 160. Current term is 161. Ops: []
I20260201 21:07:55.508234 5074 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 160.128, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260201 21:07:55.508322 5074 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer 053bc98be2b84a0194c5606c4c8a3cba log is divergent from this leader: its last log entry 161.129 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 128
I20260201 21:07:55.508358 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 LEADER]: Stepping down as leader of term 160
I20260201 21:07:55.508406 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:55.508457 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 160.128, Last appended by leader: 128, Current term: 160, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.508525 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 160 FOLLOWER]: Advancing to term 161
I20260201 21:07:55.598847 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 161 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 160 index: 128. Preceding OpId from leader: term: 161 index: 129. (index mismatch)
I20260201 21:07:55.599097 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260201 21:07:55.600077 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 161 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 160 index: 128. Preceding OpId from leader: term: 161 index: 129. (index mismatch)
I20260201 21:07:55.600255 5048 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260201 21:07:55.663364 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:55.701515 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 161 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:55.701566 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 161 FOLLOWER]: Advancing to term 162
I20260201 21:07:55.702171 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.702311 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 162 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:55.702472 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 162 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.702474 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 162 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:55.702697 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 162 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:55.702788 5059 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Leader election lost for term 162. Reason: could not achieve majority
I20260201 21:07:55.709332 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 161. Current term is 162. Ops: []
I20260201 21:07:55.709563 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 161.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260201 21:07:55.709650 5048 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 LEADER]: Stepping down as leader of term 161
I20260201 21:07:55.709674 5048 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:55.709724 5048 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 161.129, Last appended by leader: 129, Current term: 161, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.709784 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 161 FOLLOWER]: Advancing to term 162
I20260201 21:07:55.800987 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 161 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:55.801041 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 161 FOLLOWER]: Advancing to term 162
I20260201 21:07:55.801571 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.801676 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 162 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:55.801822 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 162 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.801821 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 162 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:55.801916 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Leader election vote request: Denying vote to candidate 550b2d5cf3684c8095905699979b84f9 in current term 162: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:55.802449 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 162 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 162.
I20260201 21:07:55.802611 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 162 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:55.802699 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 FOLLOWER]: Leader election won for term 162
I20260201 21:07:55.802749 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:55.802802 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 161.129, Last appended by leader: 129, Current term: 162, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.803177 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 161 to 162, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 162 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:55.829140 5059 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:55.829211 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 162 FOLLOWER]: Advancing to term 163
I20260201 21:07:55.829659 5059 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.829779 5059 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 163 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:55.829952 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 163 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:55.830011 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 162 FOLLOWER]: Advancing to term 163
I20260201 21:07:55.829952 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 163 candidate_status { last_received { term: 161 index: 129 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:55.830456 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 163 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 163.
I20260201 21:07:55.830614 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 163 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:55.830696 5059 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 FOLLOWER]: Leader election won for term 163
I20260201 21:07:55.830796 5059 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:55.830832 5059 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 161.129, Last appended by leader: 129, Current term: 163, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.831126 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 162 to 163, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 163 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:55.894696 4806 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 163 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 162. Current term is 163. Ops: []
I20260201 21:07:55.894894 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: INVALID_TERM, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260201 21:07:55.894987 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 LEADER]: Stepping down as leader of term 162
I20260201 21:07:55.895022 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:55.895078 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 162.130, Last appended by leader: 130, Current term: 162, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:55.895139 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 162 FOLLOWER]: Advancing to term 163
I20260201 21:07:55.943631 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 163 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 161 index: 129. Preceding OpId from leader: term: 163 index: 130. (index mismatch)
I20260201 21:07:55.943843 5059 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260201 21:07:55.944651 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 163 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 162 index: 130. Preceding OpId from leader: term: 163 index: 130. (term mismatch)
I20260201 21:07:55.944698 4730 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting all ops after (but not including) 129
I20260201 21:07:55.944720 4730 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: Aborting uncommitted NO_OP operation due to leader change: 162.130
I20260201 21:07:55.944737 4730 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 163 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:55.944880 5076 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260201 21:07:56.045601 5048 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 163 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:56.045678 5048 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 163 FOLLOWER]: Advancing to term 164
I20260201 21:07:56.046283 5048 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.046468 5048 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 164 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:56.046667 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 164 candidate_status { last_received { term: 163 index: 130 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:56.046667 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 164 candidate_status { last_received { term: 163 index: 130 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.046777 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 163 FOLLOWER]: Advancing to term 164
I20260201 21:07:56.047362 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 164 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 164.
I20260201 21:07:56.047506 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 164 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:56.047617 5048 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 FOLLOWER]: Leader election won for term 164
I20260201 21:07:56.047675 5048 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:56.047721 5048 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 163.130, Last appended by leader: 130, Current term: 164, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.047857 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 164 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 163. Current term is 164. Ops: []
I20260201 21:07:56.047989 5059 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 163.130, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260201 21:07:56.048079 5059 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 LEADER]: Stepping down as leader of term 163
I20260201 21:07:56.048105 5059 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:56.048143 5059 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 163.130, Last appended by leader: 130, Current term: 163, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.048151 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 163 to 164, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 164 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:56.048282 5059 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 163 FOLLOWER]: Advancing to term 164
I20260201 21:07:56.152493 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 164 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:56.152567 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 164 FOLLOWER]: Advancing to term 165
I20260201 21:07:56.153184 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.153338 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 165 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:56.153535 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 165 candidate_status { last_received { term: 163 index: 130 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.153539 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 165 candidate_status { last_received { term: 163 index: 130 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:56.153614 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 164 FOLLOWER]: Advancing to term 165
I20260201 21:07:56.154120 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 165 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 165.
I20260201 21:07:56.154281 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 165 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:56.154356 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 FOLLOWER]: Leader election won for term 165
I20260201 21:07:56.154402 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:56.154446 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 163.130, Last appended by leader: 130, Current term: 165, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.154798 4625 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 164 to 165, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 165 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:56.169623 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 164. Current term is 165. Ops: []
I20260201 21:07:56.169824 5048 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260201 21:07:56.169915 5048 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 165.131 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 130
I20260201 21:07:56.169958 5075 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 LEADER]: Stepping down as leader of term 164
I20260201 21:07:56.169996 5075 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:56.170045 5075 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 164.131, Last appended by leader: 131, Current term: 164, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.170116 5075 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 164 FOLLOWER]: Advancing to term 165
I20260201 21:07:56.257161 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 165 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 164 index: 131. Preceding OpId from leader: term: 165 index: 131. (term mismatch)
I20260201 21:07:56.257218 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 130
I20260201 21:07:56.257239 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 164.131
I20260201 21:07:56.257256 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 165 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:56.257484 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260201 21:07:56.258426 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 165 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 163 index: 130. Preceding OpId from leader: term: 165 index: 131. (index mismatch)
I20260201 21:07:56.258610 5077 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260201 21:07:56.456856 5076 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 165 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:56.456939 5076 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 165 FOLLOWER]: Advancing to term 166
I20260201 21:07:56.457629 5076 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 166 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.457769 5076 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 166 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:56.457940 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 166 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:56.457940 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 166 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:56.458177 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 166 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:56.458293 5076 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 166 FOLLOWER]: Leader election lost for term 166. Reason: could not achieve majority
I20260201 21:07:56.474677 5075 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 165 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:56.474722 5075 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 165 FOLLOWER]: Advancing to term 166
I20260201 21:07:56.475270 5075 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 166 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.475394 5075 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 166 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:56.475571 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 166 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:56.475571 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 166 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.475677 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 166 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 166: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:56.475832 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 166 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba; no voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:56.475915 5075 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 166 FOLLOWER]: Leader election lost for term 166. Reason: could not achieve majority
I20260201 21:07:56.480902 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 166 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 165. Current term is 166. Ops: []
I20260201 21:07:56.481104 5060 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 165.131, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260201 21:07:56.481215 5060 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 LEADER]: Stepping down as leader of term 165
I20260201 21:07:56.481246 5060 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:56.481302 5060 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 165.131, Last appended by leader: 131, Current term: 165, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.481369 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 165 FOLLOWER]: Advancing to term 166
I20260201 21:07:56.582264 5075 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 166 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:56.582333 5075 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 166 FOLLOWER]: Advancing to term 167
I20260201 21:07:56.582912 5075 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.583047 5075 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 167 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:56.583258 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 167 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:56.583279 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 167 candidate_status { last_received { term: 165 index: 131 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.583349 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 166 FOLLOWER]: Advancing to term 167
I20260201 21:07:56.583374 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 166 FOLLOWER]: Advancing to term 167
I20260201 21:07:56.583875 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 167 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 167.
I20260201 21:07:56.583882 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 167 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 167.
I20260201 21:07:56.584043 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 167 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters:
I20260201 21:07:56.584137 5075 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 FOLLOWER]: Leader election won for term 167
I20260201 21:07:56.584187 5075 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:56.584241 5075 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 165.131, Last appended by leader: 131, Current term: 167, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.584625 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 165 to 167, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 167 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:56.663632 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:07:56.672151 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 167 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 165 index: 131. Preceding OpId from leader: term: 167 index: 132. (index mismatch)
I20260201 21:07:56.672390 5075 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260201 21:07:56.673302 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 167 FOLLOWER]: Refusing update from remote peer 053bc98be2b84a0194c5606c4c8a3cba: Log matching property violated. Preceding OpId in replica: term: 165 index: 131. Preceding OpId from leader: term: 167 index: 132. (index mismatch)
I20260201 21:07:56.673583 5075 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260201 21:07:56.774169 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 167 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:56.774242 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 167 FOLLOWER]: Advancing to term 168
I20260201 21:07:56.774865 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.775038 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 168 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:56.775170 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 168 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:56.775189 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 168 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.775424 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 168 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:56.775564 5060 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Leader election lost for term 168. Reason: could not achieve majority
I20260201 21:07:56.785507 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 167. Current term is 168. Ops: []
I20260201 21:07:56.785681 5075 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 167.132, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260201 21:07:56.785770 5075 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 LEADER]: Stepping down as leader of term 167
I20260201 21:07:56.785800 5075 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:56.785847 5075 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 167.132, Last appended by leader: 132, Current term: 167, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.785897 5075 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 167 FOLLOWER]: Advancing to term 168
I20260201 21:07:56.860112 5076 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 167 FOLLOWER]: Starting leader election (detected failure of leader 053bc98be2b84a0194c5606c4c8a3cba)
I20260201 21:07:56.860188 5076 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 167 FOLLOWER]: Advancing to term 168
I20260201 21:07:56.860788 5076 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.860965 5076 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 168 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:56.861119 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 168 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:56.861132 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 168 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:56.861267 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Leader election vote request: Denying vote to candidate 735a2f068a414be8bd12bccb5a153190 in current term 168: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:56.861755 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 168 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 168.
I20260201 21:07:56.861927 4846 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 168 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:56.862001 5076 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 FOLLOWER]: Leader election won for term 168
I20260201 21:07:56.862095 5076 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:56.862170 5076 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 167.132, Last appended by leader: 132, Current term: 168, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.862619 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 167 to 168, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 168 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:56.888080 5060 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:56.888134 5060 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 168 FOLLOWER]: Advancing to term 169
I20260201 21:07:56.888638 5060 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.888767 5060 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 169 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:56.888892 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 169 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:56.888916 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 169 candidate_status { last_received { term: 167 index: 132 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:56.888975 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 168 FOLLOWER]: Advancing to term 169
I20260201 21:07:56.889516 4806 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 169 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 169.
I20260201 21:07:56.889662 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 169 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:56.889752 5060 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 FOLLOWER]: Leader election won for term 169
I20260201 21:07:56.889797 5060 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:56.889839 5060 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 167.132, Last appended by leader: 132, Current term: 169, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.890159 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 168 to 169, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 169 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:56.940122 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 LEADER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 168. Current term is 169. Ops: []
I20260201 21:07:56.940335 5076 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260201 21:07:56.940409 5076 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer 550b2d5cf3684c8095905699979b84f9 log is divergent from this leader: its last log entry 169.133 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 132
I20260201 21:07:56.940429 5076 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 LEADER]: Stepping down as leader of term 168
I20260201 21:07:56.940443 5076 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:56.940505 5076 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 168.133, Last appended by leader: 133, Current term: 168, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:56.940563 5076 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 168 FOLLOWER]: Advancing to term 169
I20260201 21:07:56.978777 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 169 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 168 index: 133. Preceding OpId from leader: term: 169 index: 133. (term mismatch)
I20260201 21:07:56.978823 4881 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting all ops after (but not including) 132
I20260201 21:07:56.978835 4881 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: Aborting uncommitted NO_OP operation due to leader change: 168.133
I20260201 21:07:56.978847 4881 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 169 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:56.979025 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260201 21:07:56.979990 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 169 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 167 index: 132. Preceding OpId from leader: term: 169 index: 133. (index mismatch)
I20260201 21:07:56.980196 5060 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260201 21:07:57.188342 5076 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 169 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:57.188434 5076 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 169 FOLLOWER]: Advancing to term 170
I20260201 21:07:57.189069 5076 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.189255 5076 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 170 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:57.189406 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 170 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:57.189436 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 170 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:57.189666 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 170 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:57.189759 5076 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Leader election lost for term 170. Reason: could not achieve majority
I20260201 21:07:57.211720 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Rejecting Update request from peer 550b2d5cf3684c8095905699979b84f9 for earlier term 169. Current term is 170. Ops: []
I20260201 21:07:57.211925 5080 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 169.133, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260201 21:07:57.212021 5080 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 LEADER]: Stepping down as leader of term 169
I20260201 21:07:57.212052 5080 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 LEADER]: Becoming Follower/Learner. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:57.212103 5080 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 169.133, Last appended by leader: 133, Current term: 169, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.212159 5080 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 169 FOLLOWER]: Advancing to term 170
I20260201 21:07:57.272869 5078 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 169 FOLLOWER]: Starting leader election (detected failure of leader 550b2d5cf3684c8095905699979b84f9)
I20260201 21:07:57.272935 5078 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 169 FOLLOWER]: Advancing to term 170
I20260201 21:07:57.273552 5078 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.273679 5078 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 170 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:57.273852 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 170 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:57.273854 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 170 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:57.273936 4881 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 170: Already voted for candidate 735a2f068a414be8bd12bccb5a153190 in this term.
I20260201 21:07:57.274389 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 170 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 170.
I20260201 21:07:57.274549 4773 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 170 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 550b2d5cf3684c8095905699979b84f9; no voters: 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:57.274621 5078 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 FOLLOWER]: Leader election won for term 170
I20260201 21:07:57.274672 5078 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:57.274710 5078 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 169.133, Last appended by leader: 133, Current term: 170, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.275080 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 169 to 170, leader changed from 550b2d5cf3684c8095905699979b84f9 (127.4.125.65) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 170 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:57.326256 5076 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:57.326306 5076 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 170 FOLLOWER]: Advancing to term 171
I20260201 21:07:57.326771 5076 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.326874 5076 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 171 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:57.327026 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 171 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:57.327031 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "735a2f068a414be8bd12bccb5a153190" candidate_term: 171 candidate_status { last_received { term: 169 index: 133 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:57.327111 4730 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 170 FOLLOWER]: Advancing to term 171
I20260201 21:07:57.327598 4730 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 171 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 735a2f068a414be8bd12bccb5a153190 in term 171.
I20260201 21:07:57.327747 4848 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [CANDIDATE]: Term 171 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:57.327824 5076 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 FOLLOWER]: Leader election won for term 171
I20260201 21:07:57.327874 5076 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 LEADER]: Becoming Leader. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:57.327927 5076 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 169.133, Last appended by leader: 133, Current term: 171, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.328300 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 reported cstate change: term changed from 170 to 171, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 735a2f068a414be8bd12bccb5a153190 (127.4.125.67). New cstate: current_term: 171 leader_uuid: "735a2f068a414be8bd12bccb5a153190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:57.382545 4881 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 LEADER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 170. Current term is 171. Ops: []
I20260201 21:07:57.382552 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 171 FOLLOWER]: Rejecting Update request from peer 053bc98be2b84a0194c5606c4c8a3cba for earlier term 170. Current term is 171. Ops: []
I20260201 21:07:57.382752 5078 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: INVALID_TERM, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260201 21:07:57.382905 5078 consensus_queue.cc:1243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer 735a2f068a414be8bd12bccb5a153190 log is divergent from this leader: its last log entry 171.134 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 133
I20260201 21:07:57.382948 5081 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 LEADER]: Stepping down as leader of term 170
I20260201 21:07:57.383001 5081 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:57.382974 5075 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260201 21:07:57.383082 5081 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 170.134, Last appended by leader: 134, Current term: 170, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.383157 5081 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 170 FOLLOWER]: Advancing to term 171
I20260201 21:07:57.406756 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 171 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 170 index: 134. Preceding OpId from leader: term: 171 index: 134. (term mismatch)
I20260201 21:07:57.406798 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 133
I20260201 21:07:57.406810 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 170.134
I20260201 21:07:57.406822 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 171 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:57.406989 5076 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260201 21:07:57.407828 4730 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 171 FOLLOWER]: Refusing update from remote peer 735a2f068a414be8bd12bccb5a153190: Log matching property violated. Preceding OpId in replica: term: 169 index: 133. Preceding OpId from leader: term: 171 index: 134. (index mismatch)
I20260201 21:07:57.408041 5082 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260201 21:07:57.508991 5074 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 171 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:57.509052 5074 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 171 FOLLOWER]: Advancing to term 172
I20260201 21:07:57.509706 5074 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.509821 5074 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 172 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:57.509965 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 172 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:57.509984 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 172 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:57.510161 4695 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 172 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9; no voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190
I20260201 21:07:57.510268 5074 raft_consensus.cc:2749] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Leader election lost for term 172. Reason: could not achieve majority
I20260201 21:07:57.518149 4730 raft_consensus.cc:1240] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Rejecting Update request from peer 735a2f068a414be8bd12bccb5a153190 for earlier term 171. Current term is 172. Ops: []
I20260201 21:07:57.518428 5079 consensus_queue.cc:1059] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 }, Status: INVALID_TERM, Last received: 171.134, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260201 21:07:57.518505 5079 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 LEADER]: Stepping down as leader of term 171
I20260201 21:07:57.518522 5079 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 LEADER]: Becoming Follower/Learner. State: Replica: 735a2f068a414be8bd12bccb5a153190, State: Running, Role: LEADER
I20260201 21:07:57.518564 5079 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 171.134, Last appended by leader: 134, Current term: 171, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.518636 5079 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 171 FOLLOWER]: Advancing to term 172
I20260201 21:07:57.608481 5081 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 171 FOLLOWER]: Starting leader election (detected failure of leader 735a2f068a414be8bd12bccb5a153190)
I20260201 21:07:57.608553 5081 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 171 FOLLOWER]: Advancing to term 172
I20260201 21:07:57.609105 5081 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.609279 5081 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 172 election: Requested vote from peers 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179), 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395)
I20260201 21:07:57.609462 4730 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 172 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "550b2d5cf3684c8095905699979b84f9"
I20260201 21:07:57.609530 4730 raft_consensus.cc:2393] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Leader election vote request: Denying vote to candidate 053bc98be2b84a0194c5606c4c8a3cba in current term 172: Already voted for candidate 550b2d5cf3684c8095905699979b84f9 in this term.
I20260201 21:07:57.609469 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "053bc98be2b84a0194c5606c4c8a3cba" candidate_term: 172 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:57.610015 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 172 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 053bc98be2b84a0194c5606c4c8a3cba in term 172.
I20260201 21:07:57.610172 4770 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [CANDIDATE]: Term 172 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 053bc98be2b84a0194c5606c4c8a3cba, 735a2f068a414be8bd12bccb5a153190; no voters: 550b2d5cf3684c8095905699979b84f9
I20260201 21:07:57.610257 5081 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 FOLLOWER]: Leader election won for term 172
I20260201 21:07:57.610316 5081 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 LEADER]: Becoming Leader. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:57.610396 5081 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 171.134, Last appended by leader: 134, Current term: 172, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.610759 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba reported cstate change: term changed from 171 to 172, leader changed from 735a2f068a414be8bd12bccb5a153190 (127.4.125.67) to 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66). New cstate: current_term: 172 leader_uuid: "053bc98be2b84a0194c5606c4c8a3cba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:57.630690 5074 raft_consensus.cc:493] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:57.630734 5074 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 172 FOLLOWER]: Advancing to term 173
I20260201 21:07:57.631201 5074 raft_consensus.cc:515] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 173 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.631322 5074 leader_election.cc:290] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 173 election: Requested vote from peers 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66:37677), 735a2f068a414be8bd12bccb5a153190 (127.4.125.67:40179)
I20260201 21:07:57.631481 4806 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 173 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "053bc98be2b84a0194c5606c4c8a3cba"
I20260201 21:07:57.631487 4881 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0aedcd7c464c4a73a10810a3e92172b9" candidate_uuid: "550b2d5cf3684c8095905699979b84f9" candidate_term: 173 candidate_status { last_received { term: 171 index: 134 } } ignore_live_leader: false dest_uuid: "735a2f068a414be8bd12bccb5a153190"
I20260201 21:07:57.631565 4881 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 172 FOLLOWER]: Advancing to term 173
I20260201 21:07:57.632019 4881 raft_consensus.cc:2468] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 173 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 550b2d5cf3684c8095905699979b84f9 in term 173.
I20260201 21:07:57.632176 4694 leader_election.cc:304] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [CANDIDATE]: Term 173 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 550b2d5cf3684c8095905699979b84f9, 735a2f068a414be8bd12bccb5a153190; no voters: 053bc98be2b84a0194c5606c4c8a3cba
I20260201 21:07:57.632283 5074 raft_consensus.cc:2804] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 173 FOLLOWER]: Leader election won for term 173
I20260201 21:07:57.632349 5074 raft_consensus.cc:697] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 173 LEADER]: Becoming Leader. State: Replica: 550b2d5cf3684c8095905699979b84f9, State: Running, Role: LEADER
I20260201 21:07:57.632391 5074 consensus_queue.cc:237] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 171.134, Last appended by leader: 134, Current term: 173, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.632818 4624 catalog_manager.cc:5654] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 reported cstate change: term changed from 172 to 173, leader changed from 053bc98be2b84a0194c5606c4c8a3cba (127.4.125.66) to 550b2d5cf3684c8095905699979b84f9 (127.4.125.65). New cstate: current_term: 173 leader_uuid: "550b2d5cf3684c8095905699979b84f9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:57.663812 4597 timestamp_advancement-itest.cc:267] GCing logs...
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/timestamp_advancement-itest.cc:267: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/timestamp_advancement-itest.cc:332: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260201 21:07:57.663990 4597 tablet_server.cc:178] TabletServer@127.4.125.65:0 shutting down...
W20260201 21:07:57.702919 4773 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260201 21:07:57.703269 4773 consensus_peers.cc:597] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba -> Peer 550b2d5cf3684c8095905699979b84f9 (127.4.125.65:38395): Couldn't send request to peer 550b2d5cf3684c8095905699979b84f9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260201 21:07:57.708003 4881 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 173 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 171 index: 134. Preceding OpId from leader: term: 173 index: 135. (index mismatch)
I20260201 21:07:57.708214 5074 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260201 21:07:57.709033 4806 raft_consensus.cc:3055] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 LEADER]: Stepping down as leader of term 172
I20260201 21:07:57.709079 4806 raft_consensus.cc:740] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 LEADER]: Becoming Follower/Learner. State: Replica: 053bc98be2b84a0194c5606c4c8a3cba, State: Running, Role: LEADER
I20260201 21:07:57.709125 4806 consensus_queue.cc:260] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 172.135, Last appended by leader: 135, Current term: 172, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 } } peers { permanent_uuid: "735a2f068a414be8bd12bccb5a153190" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 40179 } } peers { permanent_uuid: "550b2d5cf3684c8095905699979b84f9" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 38395 } }
I20260201 21:07:57.709235 4806 raft_consensus.cc:3060] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 172 FOLLOWER]: Advancing to term 173
I20260201 21:07:57.709749 4806 raft_consensus.cc:1275] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 173 FOLLOWER]: Refusing update from remote peer 550b2d5cf3684c8095905699979b84f9: Log matching property violated. Preceding OpId in replica: term: 172 index: 135. Preceding OpId from leader: term: 173 index: 135. (term mismatch)
I20260201 21:07:57.709780 4806 pending_rounds.cc:85] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting all ops after (but not including) 134
I20260201 21:07:57.709796 4806 pending_rounds.cc:107] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: Aborting uncommitted NO_OP operation due to leader change: 172.135
I20260201 21:07:57.709815 4806 raft_consensus.cc:2889] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 173 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:57.709973 5084 consensus_queue.cc:1048] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "053bc98be2b84a0194c5606c4c8a3cba" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 37677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260201 21:07:57.817123 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:07:57.817278 4597 tablet_replica.cc:333] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9: stopping tablet replica
I20260201 21:07:57.817348 4597 raft_consensus.cc:2243] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 173 LEADER]: Raft consensus shutting down.
I20260201 21:07:57.817409 4597 raft_consensus.cc:2272] T 0aedcd7c464c4a73a10810a3e92172b9 P 550b2d5cf3684c8095905699979b84f9 [term 173 FOLLOWER]: Raft consensus is shut down!
I20260201 21:07:57.829444 4597 tablet_server.cc:195] TabletServer@127.4.125.65:0 shutdown complete.
I20260201 21:07:57.830633 4597 tablet_server.cc:178] TabletServer@127.4.125.66:0 shutting down...
I20260201 21:07:57.850656 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:07:57.850754 4597 tablet_replica.cc:333] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba: stopping tablet replica
I20260201 21:07:57.850802 4597 raft_consensus.cc:2243] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 173 FOLLOWER]: Raft consensus shutting down.
I20260201 21:07:57.850852 4597 raft_consensus.cc:2272] T 0aedcd7c464c4a73a10810a3e92172b9 P 053bc98be2b84a0194c5606c4c8a3cba [term 173 FOLLOWER]: Raft consensus is shut down!
I20260201 21:07:57.862473 4597 tablet_server.cc:195] TabletServer@127.4.125.66:0 shutdown complete.
I20260201 21:07:57.863166 4597 tablet_server.cc:178] TabletServer@127.4.125.67:0 shutting down...
I20260201 21:07:57.877571 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:07:57.877672 4597 tablet_replica.cc:333] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190: stopping tablet replica
I20260201 21:07:57.877732 4597 raft_consensus.cc:2243] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 173 FOLLOWER]: Raft consensus shutting down.
I20260201 21:07:57.877779 4597 raft_consensus.cc:2272] T 0aedcd7c464c4a73a10810a3e92172b9 P 735a2f068a414be8bd12bccb5a153190 [term 173 FOLLOWER]: Raft consensus is shut down!
I20260201 21:07:57.889516 4597 tablet_server.cc:195] TabletServer@127.4.125.67:0 shutdown complete.
I20260201 21:07:57.890172 4597 master.cc:561] Master@127.4.125.126:38163 shutting down...
I20260201 21:07:57.998998 4597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:07:57.999094 4597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:07:57.999118 4597 tablet_replica.cc:333] T 00000000000000000000000000000000 P b456e86a62224980888bf3bb1e47bb8b: stopping tablet replica
I20260201 21:07:58.011797 4597 master.cc:583] Master@127.4.125.126:38163 shutdown complete.
I20260201 21:07:58.013785 4597 test_util.cc:183] -----------------------------------------------
I20260201 21:07:58.013828 4597 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1769980045441201-4597-0
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (32569 ms)
[ RUN ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260201 21:07:58.014209 4597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.125.126:37107
I20260201 21:07:58.014324 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:58.015516 5086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.015581 5088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.015712 4597 server_base.cc:1060] running on GCE node
W20260201 21:07:58.015714 5085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.015884 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:58.015913 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:58.015930 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980078015931 us; error 0 us; skew 500 ppm
I20260201 21:07:58.016417 4597 webserver.cc:492] Webserver started at http://127.4.125.126:33631/ using document root <none> and password file <none>
I20260201 21:07:58.016495 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:58.016538 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:58.016582 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:58.016805 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/master-0-root/instance:
uuid: "1e22acc341d64731ac64354d4f36bc6a"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.017634 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:07:58.018039 5093 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.018141 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.018181 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/master-0-root
uuid: "1e22acc341d64731ac64354d4f36bc6a"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.018234 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:58.033401 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:58.033535 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:58.035701 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.126:37107
I20260201 21:07:58.037621 5145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.126:37107 every 8 connection(s)
I20260201 21:07:58.037729 5146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:58.038646 5146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a: Bootstrap starting.
I20260201 21:07:58.038889 5146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:58.039276 5146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a: No bootstrap required, opened a new log
I20260201 21:07:58.039381 5146 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER }
I20260201 21:07:58.039422 5146 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:58.039443 5146 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e22acc341d64731ac64354d4f36bc6a, State: Initialized, Role: FOLLOWER
I20260201 21:07:58.039484 5146 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER }
I20260201 21:07:58.039518 5146 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:07:58.039541 5146 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:07:58.039565 5146 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:58.039984 5146 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER }
I20260201 21:07:58.040036 5146 leader_election.cc:304] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e22acc341d64731ac64354d4f36bc6a; no voters:
I20260201 21:07:58.040136 5146 leader_election.cc:290] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 21:07:58.040174 5149 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:07:58.040269 5146 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [sys.catalog]: configured and running, proceeding with master startup.
I20260201 21:07:58.040292 5149 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 1 LEADER]: Becoming Leader. State: Replica: 1e22acc341d64731ac64354d4f36bc6a, State: Running, Role: LEADER
I20260201 21:07:58.040386 5149 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER }
I20260201 21:07:58.040598 5150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e22acc341d64731ac64354d4f36bc6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER } }
I20260201 21:07:58.040601 5151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e22acc341d64731ac64354d4f36bc6a. Latest consensus state: current_term: 1 leader_uuid: "1e22acc341d64731ac64354d4f36bc6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e22acc341d64731ac64354d4f36bc6a" member_type: VOTER } }
I20260201 21:07:58.040709 5150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [sys.catalog]: This master's current role is: LEADER
I20260201 21:07:58.040899 5151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [sys.catalog]: This master's current role is: LEADER
I20260201 21:07:58.041018 5158 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 21:07:58.041205 5158 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 21:07:58.041683 4597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 21:07:58.041704 5158 catalog_manager.cc:1357] Generated new cluster ID: 5a96fd53df7e4a469eb77449cefb750d
I20260201 21:07:58.041733 5158 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 21:07:58.063905 5158 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 21:07:58.064260 5158 catalog_manager.cc:1514] Loading token signing keys...
I20260201 21:07:58.071264 5158 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a: Generated new TSK 0
I20260201 21:07:58.071329 5158 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 21:07:58.073318 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260201 21:07:58.074385 4597 server_base.cc:1060] running on GCE node
W20260201 21:07:58.074342 5168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.074440 5170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.074501 5167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.074644 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:58.074676 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:58.074687 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980078074688 us; error 0 us; skew 500 ppm
I20260201 21:07:58.075084 4597 webserver.cc:492] Webserver started at http://127.4.125.65:39935/ using document root <none> and password file <none>
I20260201 21:07:58.075163 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:58.075201 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:58.075227 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:58.075412 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root/instance:
uuid: "6b812ed7aaa34677be95eaca8ca94121"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.076157 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:58.076522 5175 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.076632 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.076673 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "6b812ed7aaa34677be95eaca8ca94121"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.076704 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:58.086743 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:58.086880 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:58.086977 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:58.087133 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:58.087159 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.087177 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:58.087190 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.089859 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:34683
I20260201 21:07:58.089886 5238 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:34683 every 8 connection(s)
I20260201 21:07:58.090154 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:58.091113 5243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.091171 5244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.091372 4597 server_base.cc:1060] running on GCE node
W20260201 21:07:58.091349 5246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.091573 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:58.091607 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:58.091635 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980078091636 us; error 0 us; skew 500 ppm
I20260201 21:07:58.092079 4597 webserver.cc:492] Webserver started at http://127.4.125.66:33667/ using document root <none> and password file <none>
I20260201 21:07:58.092180 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:58.092218 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:58.092278 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:58.092505 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-1-root/instance:
uuid: "2c779d302c55467b8a91c58cac84e8f0"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.093495 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:07:58.093911 5251 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.094027 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.094069 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-1-root
uuid: "2c779d302c55467b8a91c58cac84e8f0"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.094112 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:58.101176 5239 heartbeater.cc:344] Connected to a master server at 127.4.125.126:37107
I20260201 21:07:58.101235 5239 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:58.101327 5239 heartbeater.cc:507] Master 127.4.125.126:37107 requested a full tablet report, sending...
I20260201 21:07:58.101577 5110 ts_manager.cc:194] Registered new tserver with Master: 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:58.102339 5110 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52132
I20260201 21:07:58.105983 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:58.106128 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:58.106233 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:58.106360 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:58.106382 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.106406 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:58.106423 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.109297 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.66:33823
I20260201 21:07:58.109354 5314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.66:33823 every 8 connection(s)
I20260201 21:07:58.109611 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:07:58.110590 5318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.110795 5321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:07:58.110903 5319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:07:58.110996 4597 server_base.cc:1060] running on GCE node
I20260201 21:07:58.111081 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:07:58.111102 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:07:58.111114 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980078111114 us; error 0 us; skew 500 ppm
I20260201 21:07:58.111570 4597 webserver.cc:492] Webserver started at http://127.4.125.67:41333/ using document root <none> and password file <none>
I20260201 21:07:58.111675 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:07:58.111718 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:07:58.111788 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:07:58.112052 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-2-root/instance:
uuid: "3081bab7263841ceb645d447a64b4477"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.112362 5315 heartbeater.cc:344] Connected to a master server at 127.4.125.126:37107
I20260201 21:07:58.112421 5315 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:58.112543 5315 heartbeater.cc:507] Master 127.4.125.126:37107 requested a full tablet report, sending...
I20260201 21:07:58.112759 5110 ts_manager.cc:194] Registered new tserver with Master: 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823)
I20260201 21:07:58.113121 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:07:58.113135 5110 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52148
I20260201 21:07:58.113628 5326 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.113713 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.113749 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-2-root
uuid: "3081bab7263841ceb645d447a64b4477"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:07:58.113777 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:07:58.141469 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:07:58.141683 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:07:58.141821 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:07:58.141983 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:07:58.142007 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.142040 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:07:58.142066 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.145177 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.67:44535
I20260201 21:07:58.145241 5389 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.67:44535 every 8 connection(s)
I20260201 21:07:58.147912 5390 heartbeater.cc:344] Connected to a master server at 127.4.125.126:37107
I20260201 21:07:58.147958 5390 heartbeater.cc:461] Registering TS with master...
I20260201 21:07:58.148025 5390 heartbeater.cc:507] Master 127.4.125.126:37107 requested a full tablet report, sending...
I20260201 21:07:58.148304 5110 ts_manager.cc:194] Registered new tserver with Master: 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:58.148591 5110 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52162
I20260201 21:07:58.148684 4597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003289674s
I20260201 21:07:58.158080 5110 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52186:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 21:07:58.158190 5110 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 21:07:58.161932 5279 tablet_service.cc:1505] Processing CreateTablet for tablet a562a39b72ef4d47baba6b62a160484e (DEFAULT_TABLE table=test-workload [id=b9392a5d2b2e4c23bd01fd89c3578170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:58.162047 5279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a562a39b72ef4d47baba6b62a160484e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:58.162530 5354 tablet_service.cc:1505] Processing CreateTablet for tablet a562a39b72ef4d47baba6b62a160484e (DEFAULT_TABLE table=test-workload [id=b9392a5d2b2e4c23bd01fd89c3578170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:58.162644 5354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a562a39b72ef4d47baba6b62a160484e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:58.163326 5411 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Bootstrap starting.
I20260201 21:07:58.163794 5411 tablet_bootstrap.cc:654] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:58.163870 5412 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: Bootstrap starting.
I20260201 21:07:58.163923 5203 tablet_service.cc:1505] Processing CreateTablet for tablet a562a39b72ef4d47baba6b62a160484e (DEFAULT_TABLE table=test-workload [id=b9392a5d2b2e4c23bd01fd89c3578170]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:07:58.163991 5203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a562a39b72ef4d47baba6b62a160484e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:07:58.164304 5412 tablet_bootstrap.cc:654] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:58.164834 5412 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: No bootstrap required, opened a new log
I20260201 21:07:58.164911 5412 ts_tablet_manager.cc:1403] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:58.165071 5412 raft_consensus.cc:359] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.165115 5412 raft_consensus.cc:385] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:58.165128 5412 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3081bab7263841ceb645d447a64b4477, State: Initialized, Role: FOLLOWER
I20260201 21:07:58.165197 5412 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.165287 5414 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Bootstrap starting.
I20260201 21:07:58.165388 5412 ts_tablet_manager.cc:1434] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.165467 5390 heartbeater.cc:499] Master 127.4.125.126:37107 was elected leader, sending a full tablet report...
I20260201 21:07:58.165740 5414 tablet_bootstrap.cc:654] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Neither blocks nor log segments found. Creating new log.
I20260201 21:07:58.166275 5414 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: No bootstrap required, opened a new log
I20260201 21:07:58.166311 5414 ts_tablet_manager.cc:1403] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:07:58.166411 5414 raft_consensus.cc:359] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.166476 5414 raft_consensus.cc:385] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:58.166489 5414 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Initialized, Role: FOLLOWER
I20260201 21:07:58.166568 5414 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.166738 5414 ts_tablet_manager.cc:1434] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260201 21:07:58.166778 5239 heartbeater.cc:499] Master 127.4.125.126:37107 was elected leader, sending a full tablet report...
I20260201 21:07:58.166926 5411 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: No bootstrap required, opened a new log
I20260201 21:07:58.166966 5411 ts_tablet_manager.cc:1403] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260201 21:07:58.167089 5411 raft_consensus.cc:359] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.167129 5411 raft_consensus.cc:385] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:07:58.167151 5411 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Initialized, Role: FOLLOWER
I20260201 21:07:58.167193 5411 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.167424 5411 ts_tablet_manager.cc:1434] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260201 21:07:58.167495 5315 heartbeater.cc:499] Master 127.4.125.126:37107 was elected leader, sending a full tablet report...
I20260201 21:07:58.203459 5419 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 21:07:58.203513 5419 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.203761 5419 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:58.206003 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121" is_pre_election: true
I20260201 21:07:58.206084 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 0.
I20260201 21:07:58.206136 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477" is_pre_election: true
I20260201 21:07:58.206216 5364 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 0.
I20260201 21:07:58.206238 5255 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121; no voters:
I20260201 21:07:58.206334 5419 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 21:07:58.206372 5419 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:58.206399 5419 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:58.206887 5419 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.206984 5419 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 1 election: Requested vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:58.207120 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:58.207131 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:58.207181 5213 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:58.207198 5364 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:07:58.207736 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 1.
I20260201 21:07:58.207828 5364 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 1.
I20260201 21:07:58.207909 5255 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121; no voters:
I20260201 21:07:58.207989 5419 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:07:58.208117 5419 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 LEADER]: Becoming Leader. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:58.208186 5419 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.208705 5109 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66). New cstate: current_term: 1 leader_uuid: "2c779d302c55467b8a91c58cac84e8f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:58.222523 5364 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 1 FOLLOWER]: Refusing update from remote peer 2c779d302c55467b8a91c58cac84e8f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 21:07:58.222532 5213 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 1 FOLLOWER]: Refusing update from remote peer 2c779d302c55467b8a91c58cac84e8f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 21:07:58.222733 5429 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:07:58.222826 5421 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:07:58.224601 5431 mvcc.cc:204] Tried to move back new op lower bound from 7249838400398721024 to 7249838400341389312. Current Snapshot: MvccSnapshot[applied={T|T < 7249838400398364672}]
I20260201 21:07:58.537031 5415 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2c779d302c55467b8a91c58cac84e8f0)
I20260201 21:07:58.537123 5415 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:58.537823 5415 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.537987 5415 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 2 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:58.540223 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:58.540635 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:58.540706 5213 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:58.541410 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3081bab7263841ceb645d447a64b4477 in term 2.
I20260201 21:07:58.541575 5330 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3081bab7263841ceb645d447a64b4477, 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0
I20260201 21:07:58.541656 5415 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 21:07:58.541745 5415 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 LEADER]: Becoming Leader. State: Replica: 3081bab7263841ceb645d447a64b4477, State: Running, Role: LEADER
I20260201 21:07:58.541855 5415 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.542332 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 reported cstate change: term changed from 1 to 2, leader changed from 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66) to 3081bab7263841ceb645d447a64b4477 (127.4.125.67). New cstate: current_term: 2 leader_uuid: "3081bab7263841ceb645d447a64b4477" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:58.544984 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 2 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 1. Current term is 2. Ops: []
I20260201 21:07:58.545197 5429 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 1.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260201 21:07:58.549437 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 LEADER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 1. Current term is 2. Ops: []
I20260201 21:07:58.549608 5429 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 1.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260201 21:07:58.549682 5429 consensus_queue.cc:1243] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer 3081bab7263841ceb645d447a64b4477 log is divergent from this leader: its last log entry 2.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260201 21:07:58.589407 5421 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 LEADER]: Stepping down as leader of term 1
I20260201 21:07:58.589460 5421 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:58.589512 5421 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.589605 5421 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:07:58.645846 5289 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 2 FOLLOWER]: Refusing update from remote peer 3081bab7263841ceb645d447a64b4477: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260201 21:07:58.646049 5415 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260201 21:07:58.659118 5213 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 2 FOLLOWER]: Refusing update from remote peer 3081bab7263841ceb645d447a64b4477: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260201 21:07:58.659308 5415 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260201 21:07:58.760737 5418 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3081bab7263841ceb645d447a64b4477)
I20260201 21:07:58.760818 5418 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:58.761519 5418 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.761693 5418 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 3 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:58.764150 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:58.764233 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:58.764236 5289 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:58.764806 5289 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b812ed7aaa34677be95eaca8ca94121 in term 3.
I20260201 21:07:58.764950 5176 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121; no voters: 3081bab7263841ceb645d447a64b4477
I20260201 21:07:58.765027 5418 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 FOLLOWER]: Leader election won for term 3
I20260201 21:07:58.765096 5418 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 LEADER]: Becoming Leader. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Running, Role: LEADER
I20260201 21:07:58.765130 5418 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.765614 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 reported cstate change: term changed from 2 to 3, leader changed from 3081bab7263841ceb645d447a64b4477 (127.4.125.67) to 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65). New cstate: current_term: 3 leader_uuid: "6b812ed7aaa34677be95eaca8ca94121" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:58.770399 5289 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 3 FOLLOWER]: Rejecting Update request from peer 3081bab7263841ceb645d447a64b4477 for earlier term 2. Current term is 3. Ops: []
I20260201 21:07:58.770581 5447 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: INVALID_TERM, Last received: 2.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260201 21:07:58.772284 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 LEADER]: Rejecting Update request from peer 3081bab7263841ceb645d447a64b4477 for earlier term 2. Current term is 3. Ops: []
I20260201 21:07:58.772483 5415 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 2.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260201 21:07:58.772547 5415 consensus_queue.cc:1243] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Peer 6b812ed7aaa34677be95eaca8ca94121 log is divergent from this leader: its last log entry 3.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260201 21:07:58.837342 5446 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 LEADER]: Stepping down as leader of term 2
I20260201 21:07:58.837409 5446 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3081bab7263841ceb645d447a64b4477, State: Running, Role: LEADER
I20260201 21:07:58.837479 5446 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.837579 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 2 FOLLOWER]: Advancing to term 3
I20260201 21:07:58.852146 5289 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 3 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 2 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260201 21:07:58.852365 5418 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260201 21:07:58.868628 5364 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 3 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 2 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260201 21:07:58.868820 5418 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260201 21:07:58.953773 5421 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b812ed7aaa34677be95eaca8ca94121)
I20260201 21:07:58.953846 5421 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:58.954444 5421 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:58.954594 5421 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 4 election: Requested vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:58.954763 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:58.954768 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:58.954986 5252 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0; no voters: 3081bab7263841ceb645d447a64b4477, 6b812ed7aaa34677be95eaca8ca94121
I20260201 21:07:58.955119 5421 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260201 21:07:58.977059 5289 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Rejecting Update request from peer 6b812ed7aaa34677be95eaca8ca94121 for earlier term 3. Current term is 4. Ops: []
I20260201 21:07:58.977278 5452 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:07:59.069799 5289 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Rejecting Update request from peer 6b812ed7aaa34677be95eaca8ca94121 for earlier term 3. Current term is 4. Ops: []
I20260201 21:07:59.069993 5418 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:07:59.094087 5421 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:59.094154 5421 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 4 FOLLOWER]: Advancing to term 5
I20260201 21:07:59.094734 5451 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 LEADER]: Stepping down as leader of term 3
I20260201 21:07:59.094780 5451 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Running, Role: LEADER
I20260201 21:07:59.094775 5421 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.094841 5451 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.094949 5451 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:59.094964 5421 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 5 election: Requested vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:59.095078 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.095141 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:59.095656 5213 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 4 FOLLOWER]: Advancing to term 5
I20260201 21:07:59.096128 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 5.
I20260201 21:07:59.096285 5255 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121; no voters: 3081bab7263841ceb645d447a64b4477
I20260201 21:07:59.096362 5421 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 FOLLOWER]: Leader election won for term 5
I20260201 21:07:59.096457 5421 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 LEADER]: Becoming Leader. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:59.096518 5421 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.096906 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 reported cstate change: term changed from 3 to 5, leader changed from 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65) to 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66). New cstate: current_term: 5 leader_uuid: "2c779d302c55467b8a91c58cac84e8f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:59.177518 5446 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6b812ed7aaa34677be95eaca8ca94121)
I20260201 21:07:59.177583 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 3 FOLLOWER]: Advancing to term 4
I20260201 21:07:59.178189 5446 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.178330 5446 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 4 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:59.178488 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.178499 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.178584 5213 raft_consensus.cc:2368] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3081bab7263841ceb645d447a64b4477 for earlier term 4. Current term is 5.
I20260201 21:07:59.178720 5330 leader_election.cc:400] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 4 election: Vote denied by peer 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683) with higher term. Message: Invalid argument: T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3081bab7263841ceb645d447a64b4477 for earlier term 4. Current term is 5.
I20260201 21:07:59.178764 5330 leader_election.cc:403] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260201 21:07:59.178830 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 4 FOLLOWER]: Advancing to term 5
I20260201 21:07:59.179309 5446 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683) with higher term. Message: Invalid argument: T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3081bab7263841ceb645d447a64b4477 for earlier term 4. Current term is 5.
I20260201 21:07:59.185221 5364 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 5 FOLLOWER]: Refusing update from remote peer 2c779d302c55467b8a91c58cac84e8f0: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260201 21:07:59.185423 5421 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:07:59.203313 5213 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Refusing update from remote peer 2c779d302c55467b8a91c58cac84e8f0: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260201 21:07:59.203614 5421 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:07:59.320326 5451 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c779d302c55467b8a91c58cac84e8f0)
I20260201 21:07:59.320387 5451 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 5 FOLLOWER]: Advancing to term 6
I20260201 21:07:59.320925 5451 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.321045 5451 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 6 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:59.321214 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.321223 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:59.321409 5176 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0, 3081bab7263841ceb645d447a64b4477
I20260201 21:07:59.321492 5451 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 21:07:59.322768 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 5. Current term is 6. Ops: []
I20260201 21:07:59.322970 5454 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.377867 5446 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2c779d302c55467b8a91c58cac84e8f0)
I20260201 21:07:59.377920 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 5 FOLLOWER]: Advancing to term 6
I20260201 21:07:59.378448 5446 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.378563 5446 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 6 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:59.378690 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.378695 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.378752 5213 raft_consensus.cc:2393] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3081bab7263841ceb645d447a64b4477 in current term 6: Already voted for candidate 6b812ed7aaa34677be95eaca8ca94121 in this term.
I20260201 21:07:59.378878 5330 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3081bab7263841ceb645d447a64b4477; no voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121
I20260201 21:07:59.378965 5446 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260201 21:07:59.385974 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 6 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 5. Current term is 6. Ops: []
I20260201 21:07:59.386194 5421 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.407366 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 5. Current term is 6. Ops: []
I20260201 21:07:59.407581 5454 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.435742 5451 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:59.435789 5451 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 6 FOLLOWER]: Advancing to term 7
I20260201 21:07:59.436270 5451 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.436380 5451 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 7 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:59.436558 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 7 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.436574 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 7 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:59.436621 5364 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 6 FOLLOWER]: Advancing to term 7
I20260201 21:07:59.437147 5364 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b812ed7aaa34677be95eaca8ca94121 in term 7.
I20260201 21:07:59.437323 5176 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3081bab7263841ceb645d447a64b4477, 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0
I20260201 21:07:59.437405 5451 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 FOLLOWER]: Leader election won for term 7
I20260201 21:07:59.437459 5451 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 LEADER]: Becoming Leader. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Running, Role: LEADER
I20260201 21:07:59.437510 5451 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.437896 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 reported cstate change: term changed from 5 to 7, leader changed from 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66) to 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65). New cstate: current_term: 7 leader_uuid: "6b812ed7aaa34677be95eaca8ca94121" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:59.475790 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 7 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 5. Current term is 7. Ops: []
I20260201 21:07:59.475980 5454 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.518121 5289 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 LEADER]: Stepping down as leader of term 5
I20260201 21:07:59.518187 5289 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:59.518255 5289 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.518349 5289 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 5 FOLLOWER]: Advancing to term 7
I20260201 21:07:59.518916 5289 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 7 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 7 index: 20. (index mismatch)
I20260201 21:07:59.519111 5451 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.527192 5364 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 7 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 7 index: 20. (index mismatch)
I20260201 21:07:59.527407 5451 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:07:59.628607 5446 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b812ed7aaa34677be95eaca8ca94121)
I20260201 21:07:59.628672 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:59.629349 5446 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.629484 5446 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 8 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:59.629621 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.629627 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.629839 5330 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3081bab7263841ceb645d447a64b4477; no voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121
I20260201 21:07:59.629941 5446 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260201 21:07:59.643002 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Rejecting Update request from peer 6b812ed7aaa34677be95eaca8ca94121 for earlier term 7. Current term is 8. Ops: []
I20260201 21:07:59.643196 5452 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 7.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:07:59.697258 5418 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 LEADER]: Stepping down as leader of term 7
I20260201 21:07:59.697327 5418 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Running, Role: LEADER
I20260201 21:07:59.697400 5418 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.697505 5418 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:59.743817 5453 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6b812ed7aaa34677be95eaca8ca94121)
I20260201 21:07:59.743899 5453 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 7 FOLLOWER]: Advancing to term 8
I20260201 21:07:59.744505 5453 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.744645 5453 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 8 election: Requested vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:59.744863 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.744863 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:59.744971 5364 raft_consensus.cc:2393] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c779d302c55467b8a91c58cac84e8f0 in current term 8: Already voted for candidate 3081bab7263841ceb645d447a64b4477 in this term.
I20260201 21:07:59.745514 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 8.
I20260201 21:07:59.745688 5255 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121; no voters: 3081bab7263841ceb645d447a64b4477
I20260201 21:07:59.745787 5453 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 FOLLOWER]: Leader election won for term 8
I20260201 21:07:59.745839 5453 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 LEADER]: Becoming Leader. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:59.745908 5453 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.746389 5109 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 reported cstate change: term changed from 7 to 8, leader changed from 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65) to 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66). New cstate: current_term: 8 leader_uuid: "2c779d302c55467b8a91c58cac84e8f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:07:59.754278 5446 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:07:59.754345 5446 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:59.755060 5446 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.755204 5446 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 9 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
I20260201 21:07:59.755368 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 9 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.755367 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "3081bab7263841ceb645d447a64b4477" candidate_term: 9 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:07:59.755470 5213 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:59.755956 5213 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3081bab7263841ceb645d447a64b4477 in term 9.
I20260201 21:07:59.756122 5330 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3081bab7263841ceb645d447a64b4477, 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0
I20260201 21:07:59.756215 5446 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 FOLLOWER]: Leader election won for term 9
I20260201 21:07:59.756341 5446 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 LEADER]: Becoming Leader. State: Replica: 3081bab7263841ceb645d447a64b4477, State: Running, Role: LEADER
I20260201 21:07:59.756405 5446 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
W20260201 21:07:59.769204 5421 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
I20260201 21:07:59.779143 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 reported cstate change: term changed from 8 to 9, leader changed from 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66) to 3081bab7263841ceb645d447a64b4477 (127.4.125.67). New cstate: current_term: 9 leader_uuid: "3081bab7263841ceb645d447a64b4477" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: HEALTHY } } }
I20260201 21:07:59.822729 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 LEADER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 8. Current term is 9. Ops: []
I20260201 21:07:59.822975 5421 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:07:59.823061 5421 consensus_queue.cc:1243] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer 3081bab7263841ceb645d447a64b4477 log is divergent from this leader: its last log entry 9.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260201 21:07:59.835312 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 9 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 8. Current term is 9. Ops: []
I20260201 21:07:59.835505 5421 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:07:59.837332 5213 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 9 FOLLOWER]: Refusing update from remote peer 3081bab7263841ceb645d447a64b4477: Log matching property violated. Preceding OpId in replica: term: 7 index: 20. Preceding OpId from leader: term: 9 index: 21. (index mismatch)
I20260201 21:07:59.837520 5446 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:07:59.843492 5289 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 LEADER]: Stepping down as leader of term 8
I20260201 21:07:59.843531 5289 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:07:59.843569 5289 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 8.21, Last appended by leader: 21, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.843668 5289 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 8 FOLLOWER]: Advancing to term 9
I20260201 21:07:59.844298 5289 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 9 FOLLOWER]: Refusing update from remote peer 3081bab7263841ceb645d447a64b4477: Log matching property violated. Preceding OpId in replica: term: 8 index: 21. Preceding OpId from leader: term: 9 index: 21. (term mismatch)
I20260201 21:07:59.844334 5289 pending_rounds.cc:85] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Aborting all ops after (but not including) 20
I20260201 21:07:59.844347 5289 pending_rounds.cc:107] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Aborting uncommitted NO_OP operation due to leader change: 8.21
I20260201 21:07:59.844373 5289 raft_consensus.cc:2889] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:07:59.844597 5456 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:07:59.938903 5418 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3081bab7263841ceb645d447a64b4477)
I20260201 21:07:59.938971 5418 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:07:59.939558 5418 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.939674 5418 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 10 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:07:59.939833 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 10 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:07:59.939859 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 10 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:07:59.940018 5176 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0, 3081bab7263841ceb645d447a64b4477
I20260201 21:07:59.940101 5418 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260201 21:07:59.957537 5213 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Rejecting Update request from peer 3081bab7263841ceb645d447a64b4477 for earlier term 9. Current term is 10. Ops: []
I20260201 21:07:59.957759 5456 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 }, Status: INVALID_TERM, Last received: 9.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:07:59.992051 5456 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 LEADER]: Stepping down as leader of term 9
I20260201 21:07:59.992106 5456 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3081bab7263841ceb645d447a64b4477, State: Running, Role: LEADER
I20260201 21:07:59.992168 5456 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 9.21, Last appended by leader: 21, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:07:59.992228 5456 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:08:00.069442 5453 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3081bab7263841ceb645d447a64b4477)
I20260201 21:08:00.069497 5453 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 9 FOLLOWER]: Advancing to term 10
I20260201 21:08:00.070024 5453 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.070147 5453 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 10 election: Requested vote from peers 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:08:00.070292 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 10 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:08:00.070292 5213 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "2c779d302c55467b8a91c58cac84e8f0" candidate_term: 10 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "6b812ed7aaa34677be95eaca8ca94121"
I20260201 21:08:00.070391 5213 raft_consensus.cc:2393] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2c779d302c55467b8a91c58cac84e8f0 in current term 10: Already voted for candidate 6b812ed7aaa34677be95eaca8ca94121 in this term.
I20260201 21:08:00.070890 5364 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c779d302c55467b8a91c58cac84e8f0 in term 10.
I20260201 21:08:00.071029 5252 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2c779d302c55467b8a91c58cac84e8f0, 3081bab7263841ceb645d447a64b4477; no voters: 6b812ed7aaa34677be95eaca8ca94121
I20260201 21:08:00.071098 5453 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 FOLLOWER]: Leader election won for term 10
I20260201 21:08:00.071151 5453 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 LEADER]: Becoming Leader. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:08:00.071194 5453 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 9.21, Last appended by leader: 21, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.071609 5110 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 reported cstate change: term changed from 9 to 10, leader changed from 3081bab7263841ceb645d447a64b4477 (127.4.125.67) to 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66). New cstate: current_term: 10 leader_uuid: "2c779d302c55467b8a91c58cac84e8f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:08:00.087647 5418 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:08:00.087699 5418 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:08:00.088196 5418 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.088304 5418 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 11 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
I20260201 21:08:00.088456 5289 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 11 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "2c779d302c55467b8a91c58cac84e8f0"
I20260201 21:08:00.088478 5364 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a562a39b72ef4d47baba6b62a160484e" candidate_uuid: "6b812ed7aaa34677be95eaca8ca94121" candidate_term: 11 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "3081bab7263841ceb645d447a64b4477"
I20260201 21:08:00.088557 5364 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:08:00.089030 5364 raft_consensus.cc:2468] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b812ed7aaa34677be95eaca8ca94121 in term 11.
I20260201 21:08:00.089206 5176 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3081bab7263841ceb645d447a64b4477, 6b812ed7aaa34677be95eaca8ca94121; no voters:
I20260201 21:08:00.089294 5418 raft_consensus.cc:2804] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Leader election won for term 11
I20260201 21:08:00.089352 5418 raft_consensus.cc:697] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 LEADER]: Becoming Leader. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Running, Role: LEADER
I20260201 21:08:00.089408 5418 consensus_queue.cc:237] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 9.21, Last appended by leader: 21, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.090268 5109 catalog_manager.cc:5654] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 reported cstate change: term changed from 10 to 11, leader changed from 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66) to 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65). New cstate: current_term: 11 leader_uuid: "6b812ed7aaa34677be95eaca8ca94121" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } health_report { overall_health: UNKNOWN } } }
I20260201 21:08:00.097102 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.098285 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.100404 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.104521 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.112670 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.128847 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.152912 5364 raft_consensus.cc:1240] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 11 FOLLOWER]: Rejecting Update request from peer 2c779d302c55467b8a91c58cac84e8f0 for earlier term 10. Current term is 11. Ops: []
I20260201 21:08:00.153124 5453 consensus_queue.cc:1059] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: INVALID_TERM, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:08:00.153236 5453 raft_consensus.cc:3055] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 LEADER]: Stepping down as leader of term 10
I20260201 21:08:00.153273 5453 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2c779d302c55467b8a91c58cac84e8f0, State: Running, Role: LEADER
I20260201 21:08:00.153321 5453 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 10.22, Last appended by leader: 22, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.153388 5453 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 10 FOLLOWER]: Advancing to term 11
I20260201 21:08:00.160993 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.197780 5364 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 11 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 9 index: 21. Preceding OpId from leader: term: 11 index: 22. (index mismatch)
I20260201 21:08:00.197992 5418 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:08:00.198858 5289 raft_consensus.cc:1275] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 11 FOLLOWER]: Refusing update from remote peer 6b812ed7aaa34677be95eaca8ca94121: Log matching property violated. Preceding OpId in replica: term: 10 index: 22. Preceding OpId from leader: term: 11 index: 22. (term mismatch)
I20260201 21:08:00.198904 5289 pending_rounds.cc:85] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Aborting all ops after (but not including) 21
I20260201 21:08:00.198933 5289 pending_rounds.cc:107] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: Aborting uncommitted NO_OP operation due to leader change: 10.22
I20260201 21:08:00.198951 5289 raft_consensus.cc:2889] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260201 21:08:00.199258 5418 consensus_queue.cc:1048] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:08:00.225144 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:00.225258 4597 log_reader.cc:385] T a562a39b72ef4d47baba6b62a160484e: removed 1 log segments from log reader
I20260201 21:08:00.225283 4597 log.cc:1079] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Deleting log segment in path: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root/wals/a562a39b72ef4d47baba6b62a160484e/wal-000000001 (ops 1-16)
I20260201 21:08:00.225663 4597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260201 21:08:00.225706 4597 master.cc:561] Master@127.4.125.126:37107 shutting down...
I20260201 21:08:00.285091 4597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:08:00.285169 4597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:00.285211 4597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1e22acc341d64731ac64354d4f36bc6a: stopping tablet replica
I20260201 21:08:00.296950 4597 master.cc:583] Master@127.4.125.126:37107 shutdown complete.
I20260201 21:08:00.298278 4597 tablet_server.cc:178] TabletServer@127.4.125.65:0 shutting down...
W20260201 21:08:00.305017 5239 heartbeater.cc:646] Failed to heartbeat to 127.4.125.126:37107 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.125.126:37107: connect: Connection refused (error 111)
I20260201 21:08:00.341538 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:00.341671 4597 tablet_replica.cc:333] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: stopping tablet replica
I20260201 21:08:00.341725 4597 raft_consensus.cc:2243] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 LEADER]: Raft consensus shutting down.
I20260201 21:08:00.341779 4597 raft_consensus.cc:2272] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:00.343612 4597 tablet_server.cc:195] TabletServer@127.4.125.65:0 shutdown complete.
I20260201 21:08:00.344363 4597 tablet_server.cc:178] TabletServer@127.4.125.66:0 shutting down...
I20260201 21:08:00.361055 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:00.361270 4597 tablet_replica.cc:333] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0: stopping tablet replica
I20260201 21:08:00.361320 4597 raft_consensus.cc:2243] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:00.361390 4597 raft_consensus.cc:2272] T a562a39b72ef4d47baba6b62a160484e P 2c779d302c55467b8a91c58cac84e8f0 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:00.362857 4597 tablet_server.cc:195] TabletServer@127.4.125.66:0 shutdown complete.
I20260201 21:08:00.363821 4597 tablet_server.cc:178] TabletServer@127.4.125.67:0 shutting down...
I20260201 21:08:00.392966 5456 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6b812ed7aaa34677be95eaca8ca94121)
I20260201 21:08:00.393018 5456 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 11 FOLLOWER]: Advancing to term 12
I20260201 21:08:00.393605 5456 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.393735 5456 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 12 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683)
W20260201 21:08:00.394356 5330 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 6b812ed7aaa34677be95eaca8ca94121 (127.4.125.65:34683): Network error: Client connection negotiation failed: client connection to 127.4.125.65:34683: connect: Connection refused (error 111)
W20260201 21:08:00.394415 5327 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823): Network error: Client connection negotiation failed: client connection to 127.4.125.66:33823: connect: Connection refused (error 111)
I20260201 21:08:00.394461 5327 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3081bab7263841ceb645d447a64b4477; no voters: 2c779d302c55467b8a91c58cac84e8f0, 6b812ed7aaa34677be95eaca8ca94121
I20260201 21:08:00.394524 5456 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260201 21:08:00.396453 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:00.396546 4597 tablet_replica.cc:333] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477: stopping tablet replica
I20260201 21:08:00.396592 4597 raft_consensus.cc:2243] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:00.396631 4597 raft_consensus.cc:2272] T a562a39b72ef4d47baba6b62a160484e P 3081bab7263841ceb645d447a64b4477 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:00.408231 4597 tablet_server.cc:195] TabletServer@127.4.125.67:0 shutdown complete.
I20260201 21:08:00.408890 4597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260201 21:08:00.408989 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:00.409999 5462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.410044 5463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.410095 5465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.410221 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:00.410290 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:00.410319 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:00.410331 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980080410332 us; error 0 us; skew 500 ppm
I20260201 21:08:00.410791 4597 webserver.cc:492] Webserver started at http://127.4.125.65:39935/ using document root <none> and password file <none>
I20260201 21:08:00.410876 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:00.410912 4597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 21:08:00.411475 4597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.412838 5472 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.412966 4597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:00.413010 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "6b812ed7aaa34677be95eaca8ca94121"
format_stamp: "Formatted at 2026-02-01 21:07:58 on dist-test-slave-cnth"
I20260201 21:08:00.413061 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5296
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:00.419504 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:00.419643 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:00.419757 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:00.419986 5479 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260201 21:08:00.420543 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 21:08:00.420578 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:00.420608 4597 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 21:08:00.420949 4597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 21:08:00.420989 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.420990 5479 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Bootstrap starting.
I20260201 21:08:00.422361 5479 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 21:08:00.422650 5479 tablet_bootstrap.cc:492] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Bootstrap complete.
I20260201 21:08:00.422747 5479 ts_tablet_manager.cc:1403] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260201 21:08:00.422853 5479 raft_consensus.cc:359] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.422919 5479 raft_consensus.cc:740] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b812ed7aaa34677be95eaca8ca94121, State: Initialized, Role: FOLLOWER
I20260201 21:08:00.422963 5479 consensus_queue.cc:260] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 22, Last appended: 11.22, Last appended by leader: 22, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.423112 5479 ts_tablet_manager.cc:1434] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260201 21:08:00.423727 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:34683
I20260201 21:08:00.425701 5538 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:34683 every 8 connection(s)
W20260201 21:08:00.426667 5539 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260201 21:08:00.431035 4597 tablet_server.cc:178] TabletServer@127.4.125.65:34683 shutting down...
I20260201 21:08:00.532650 5526 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:08:00.532716 5526 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 11 FOLLOWER]: Advancing to term 12
I20260201 21:08:00.533319 5526 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.533456 5526 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 12 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
W20260201 21:08:00.533991 5473 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823): Network error: Client connection negotiation failed: client connection to 127.4.125.66:33823: connect: Connection refused (error 111)
W20260201 21:08:00.534034 5473 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535): Network error: Client connection negotiation failed: client connection to 127.4.125.67:44535: connect: Connection refused (error 111)
I20260201 21:08:00.534049 5473 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0, 3081bab7263841ceb645d447a64b4477
I20260201 21:08:00.534112 5526 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260201 21:08:00.660669 5526 raft_consensus.cc:493] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:08:00.660744 5526 raft_consensus.cc:3060] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 12 FOLLOWER]: Advancing to term 13
I20260201 21:08:00.661355 5526 raft_consensus.cc:515] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c779d302c55467b8a91c58cac84e8f0" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 33823 } } peers { permanent_uuid: "6b812ed7aaa34677be95eaca8ca94121" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 34683 } } peers { permanent_uuid: "3081bab7263841ceb645d447a64b4477" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 44535 } }
I20260201 21:08:00.661477 5526 leader_election.cc:290] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 13 election: Requested vote from peers 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823), 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535)
W20260201 21:08:00.661970 5473 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 2c779d302c55467b8a91c58cac84e8f0 (127.4.125.66:33823): Network error: Client connection negotiation failed: client connection to 127.4.125.66:33823: connect: Connection refused (error 111)
W20260201 21:08:00.662021 5473 leader_election.cc:336] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3081bab7263841ceb645d447a64b4477 (127.4.125.67:44535): Network error: Client connection negotiation failed: client connection to 127.4.125.67:44535: connect: Connection refused (error 111)
I20260201 21:08:00.662036 5473 leader_election.cc:304] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b812ed7aaa34677be95eaca8ca94121; no voters: 2c779d302c55467b8a91c58cac84e8f0, 3081bab7263841ceb645d447a64b4477
I20260201 21:08:00.662101 5526 raft_consensus.cc:2749] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260201 21:08:00.676124 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:00.676291 4597 tablet_replica.cc:333] stopping tablet replica
I20260201 21:08:00.676374 4597 raft_consensus.cc:2243] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:00.676419 4597 raft_consensus.cc:2272] T a562a39b72ef4d47baba6b62a160484e P 6b812ed7aaa34677be95eaca8ca94121 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:00.688006 4597 tablet_server.cc:195] TabletServer@127.4.125.65:34683 shutdown complete.
[ OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (2677 ms)
[ RUN ] TimestampAdvancementITest.Kudu2463Test
I20260201 21:08:00.692257 4597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.125.126:35415
I20260201 21:08:00.692400 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:00.693620 5547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.693730 5546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.693754 5549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.693847 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:00.693984 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:00.694023 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:00.694047 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980080694047 us; error 0 us; skew 500 ppm
I20260201 21:08:00.694582 4597 webserver.cc:492] Webserver started at http://127.4.125.126:38827/ using document root <none> and password file <none>
I20260201 21:08:00.694662 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:00.694703 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:00.694751 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:00.694981 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/master-0-root/instance:
uuid: "c593388b8d9946b684913d1b4d74b65a"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.695792 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:00.696221 5554 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.696324 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.696369 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/master-0-root
uuid: "c593388b8d9946b684913d1b4d74b65a"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.696410 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:00.715564 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:00.715710 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:00.718011 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.126:35415
I20260201 21:08:00.718492 5606 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.126:35415 every 8 connection(s)
I20260201 21:08:00.718644 5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:00.719589 5607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a: Bootstrap starting.
I20260201 21:08:00.719843 5607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:00.720279 5607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a: No bootstrap required, opened a new log
I20260201 21:08:00.720388 5607 raft_consensus.cc:359] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER }
I20260201 21:08:00.720441 5607 raft_consensus.cc:385] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:00.720463 5607 raft_consensus.cc:740] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c593388b8d9946b684913d1b4d74b65a, State: Initialized, Role: FOLLOWER
I20260201 21:08:00.720515 5607 consensus_queue.cc:260] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER }
I20260201 21:08:00.720546 5607 raft_consensus.cc:399] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:08:00.720566 5607 raft_consensus.cc:493] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:08:00.720592 5607 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:00.721000 5607 raft_consensus.cc:515] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER }
I20260201 21:08:00.721050 5607 leader_election.cc:304] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c593388b8d9946b684913d1b4d74b65a; no voters:
I20260201 21:08:00.721136 5607 leader_election.cc:290] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 21:08:00.721210 5610 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:08:00.721315 5607 sys_catalog.cc:565] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [sys.catalog]: configured and running, proceeding with master startup.
I20260201 21:08:00.721341 5610 raft_consensus.cc:697] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 1 LEADER]: Becoming Leader. State: Replica: c593388b8d9946b684913d1b4d74b65a, State: Running, Role: LEADER
I20260201 21:08:00.721446 5610 consensus_queue.cc:237] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER }
I20260201 21:08:00.721686 5611 sys_catalog.cc:455] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c593388b8d9946b684913d1b4d74b65a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER } }
I20260201 21:08:00.721697 5612 sys_catalog.cc:455] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c593388b8d9946b684913d1b4d74b65a. Latest consensus state: current_term: 1 leader_uuid: "c593388b8d9946b684913d1b4d74b65a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c593388b8d9946b684913d1b4d74b65a" member_type: VOTER } }
I20260201 21:08:00.721834 5611 sys_catalog.cc:458] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:00.721849 5612 sys_catalog.cc:458] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:00.722105 5619 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 21:08:00.722223 5619 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 21:08:00.722582 4597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 21:08:00.722767 5619 catalog_manager.cc:1357] Generated new cluster ID: 1c9a2665f3c24cb79695fe4c00dbbca6
I20260201 21:08:00.722797 5619 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 21:08:00.739876 5619 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 21:08:00.740214 5619 catalog_manager.cc:1514] Loading token signing keys...
I20260201 21:08:00.743499 5619 catalog_manager.cc:6027] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a: Generated new TSK 0
I20260201 21:08:00.743567 5619 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 21:08:00.754228 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:00.755556 5629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.755621 5631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.755662 4597 server_base.cc:1060] running on GCE node
W20260201 21:08:00.755577 5628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.755810 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:00.755843 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:00.755856 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980080755856 us; error 0 us; skew 500 ppm
I20260201 21:08:00.756299 4597 webserver.cc:492] Webserver started at http://127.4.125.65:42073/ using document root <none> and password file <none>
I20260201 21:08:00.756374 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:00.756418 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:00.756464 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:00.756664 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root/instance:
uuid: "1b5cd1b7e2a749d2884a860ac710d91c"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.757498 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260201 21:08:00.757900 5636 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.758014 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.758054 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "1b5cd1b7e2a749d2884a860ac710d91c"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.758100 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:00.766992 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:00.767148 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:00.767258 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:00.767400 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:00.767431 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.767457 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:00.767482 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.770051 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:42801
I20260201 21:08:00.770067 5699 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:42801 every 8 connection(s)
I20260201 21:08:00.770354 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:00.771292 5704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.771380 5707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.771489 5705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.771677 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:00.771790 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:00.771822 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:00.771835 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980080771836 us; error 0 us; skew 500 ppm
I20260201 21:08:00.772330 4597 webserver.cc:492] Webserver started at http://127.4.125.66:36375/ using document root <none> and password file <none>
I20260201 21:08:00.772415 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:00.772454 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:00.772495 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:00.772732 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-1-root/instance:
uuid: "222cd7cd7773481f85566446045798b6"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.773734 5700 heartbeater.cc:344] Connected to a master server at 127.4.125.126:35415
I20260201 21:08:00.773787 5700 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:00.773800 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:08:00.773883 5700 heartbeater.cc:507] Master 127.4.125.126:35415 requested a full tablet report, sending...
I20260201 21:08:00.774071 5571 ts_manager.cc:194] Registered new tserver with Master: 1b5cd1b7e2a749d2884a860ac710d91c (127.4.125.65:42801)
I20260201 21:08:00.774296 5712 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.774423 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.774469 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-1-root
uuid: "222cd7cd7773481f85566446045798b6"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.774509 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:00.774729 5571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33496
I20260201 21:08:00.790884 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:00.791028 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:00.791136 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:00.791311 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:00.791337 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.791365 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:00.791391 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.794229 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.66:36087
I20260201 21:08:00.794272 5775 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.66:36087 every 8 connection(s)
I20260201 21:08:00.794544 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:00.795423 5779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:00.795658 5780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.795708 4597 server_base.cc:1060] running on GCE node
W20260201 21:08:00.796120 5782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:00.796263 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:00.796298 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:00.796309 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980080796310 us; error 0 us; skew 500 ppm
I20260201 21:08:00.796810 4597 webserver.cc:492] Webserver started at http://127.4.125.67:33033/ using document root <none> and password file <none>
I20260201 21:08:00.796886 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:00.796936 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:00.796977 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:00.797199 5776 heartbeater.cc:344] Connected to a master server at 127.4.125.126:35415
I20260201 21:08:00.797262 5776 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:00.797211 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-2-root/instance:
uuid: "966da8b0bd06448c8cdc4208539e768d"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.797369 5776 heartbeater.cc:507] Master 127.4.125.126:35415 requested a full tablet report, sending...
I20260201 21:08:00.797566 5571 ts_manager.cc:194] Registered new tserver with Master: 222cd7cd7773481f85566446045798b6 (127.4.125.66:36087)
I20260201 21:08:00.797976 5571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33500
I20260201 21:08:00.798231 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:08:00.798653 5787 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.798756 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.798795 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-2-root
uuid: "966da8b0bd06448c8cdc4208539e768d"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:00.798830 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:00.820510 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:00.820674 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:00.820792 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:00.820936 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:00.820958 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.820974 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:00.820999 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.823943 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.67:39385
I20260201 21:08:00.823994 5850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.67:39385 every 8 connection(s)
I20260201 21:08:00.826261 5851 heartbeater.cc:344] Connected to a master server at 127.4.125.126:35415
I20260201 21:08:00.826308 5851 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:00.826399 5851 heartbeater.cc:507] Master 127.4.125.126:35415 requested a full tablet report, sending...
I20260201 21:08:00.826591 5571 ts_manager.cc:194] Registered new tserver with Master: 966da8b0bd06448c8cdc4208539e768d (127.4.125.67:39385)
I20260201 21:08:00.826841 5571 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33502
I20260201 21:08:00.827394 4597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003296581s
I20260201 21:08:00.836302 5571 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33526:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260201 21:08:00.836405 5571 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260201 21:08:00.840332 5740 tablet_service.cc:1505] Processing CreateTablet for tablet a696f194b248477f9b0effd98feef0d9 (DEFAULT_TABLE table=test-workload [id=48887d94874049e5986ea0b349e76ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:08:00.840389 5664 tablet_service.cc:1505] Processing CreateTablet for tablet a696f194b248477f9b0effd98feef0d9 (DEFAULT_TABLE table=test-workload [id=48887d94874049e5986ea0b349e76ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:08:00.840457 5740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696f194b248477f9b0effd98feef0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:00.840497 5664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696f194b248477f9b0effd98feef0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:00.840847 5815 tablet_service.cc:1505] Processing CreateTablet for tablet a696f194b248477f9b0effd98feef0d9 (DEFAULT_TABLE table=test-workload [id=48887d94874049e5986ea0b349e76ac3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:08:00.840930 5815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a696f194b248477f9b0effd98feef0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:00.841930 5873 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Bootstrap starting.
I20260201 21:08:00.842093 5874 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: Bootstrap starting.
I20260201 21:08:00.842312 5873 tablet_bootstrap.cc:654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:00.842496 5874 tablet_bootstrap.cc:654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:00.842641 5872 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: Bootstrap starting.
I20260201 21:08:00.842854 5873 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: No bootstrap required, opened a new log
I20260201 21:08:00.842900 5873 ts_tablet_manager.cc:1403] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:00.843061 5874 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: No bootstrap required, opened a new log
I20260201 21:08:00.843080 5873 raft_consensus.cc:359] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.843109 5874 ts_tablet_manager.cc:1403] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:00.843142 5873 raft_consensus.cc:385] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:00.843106 5872 tablet_bootstrap.cc:654] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:00.843185 5873 raft_consensus.cc:740] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b5cd1b7e2a749d2884a860ac710d91c, State: Initialized, Role: FOLLOWER
I20260201 21:08:00.843254 5874 raft_consensus.cc:359] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.843271 5873 consensus_queue.cc:260] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.843308 5874 raft_consensus.cc:385] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:00.843364 5874 raft_consensus.cc:740] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966da8b0bd06448c8cdc4208539e768d, State: Initialized, Role: FOLLOWER
I20260201 21:08:00.843461 5700 heartbeater.cc:499] Master 127.4.125.126:35415 was elected leader, sending a full tablet report...
I20260201 21:08:00.843545 5874 consensus_queue.cc:260] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.843690 5873 ts_tablet_manager.cc:1434] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:00.843770 5872 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: No bootstrap required, opened a new log
I20260201 21:08:00.843820 5872 ts_tablet_manager.cc:1403] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:00.843850 5874 ts_tablet_manager.cc:1434] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:00.843922 5851 heartbeater.cc:499] Master 127.4.125.126:35415 was elected leader, sending a full tablet report...
I20260201 21:08:00.843941 5872 raft_consensus.cc:359] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.844002 5872 raft_consensus.cc:385] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:00.844020 5872 raft_consensus.cc:740] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 222cd7cd7773481f85566446045798b6, State: Initialized, Role: FOLLOWER
I20260201 21:08:00.844061 5872 consensus_queue.cc:260] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:00.844208 5872 ts_tablet_manager.cc:1434] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:00.844255 5776 heartbeater.cc:499] Master 127.4.125.126:35415 was elected leader, sending a full tablet report...
I20260201 21:08:01.062093 5877 raft_consensus.cc:493] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260201 21:08:01.062178 5877 raft_consensus.cc:515] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.062350 5877 leader_election.cc:290] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966da8b0bd06448c8cdc4208539e768d (127.4.125.67:39385), 222cd7cd7773481f85566446045798b6 (127.4.125.66:36087)
I20260201 21:08:01.065285 5825 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a696f194b248477f9b0effd98feef0d9" candidate_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966da8b0bd06448c8cdc4208539e768d" is_pre_election: true
I20260201 21:08:01.065328 5750 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a696f194b248477f9b0effd98feef0d9" candidate_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222cd7cd7773481f85566446045798b6" is_pre_election: true
I20260201 21:08:01.065359 5825 raft_consensus.cc:2468] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b5cd1b7e2a749d2884a860ac710d91c in term 0.
I20260201 21:08:01.065407 5750 raft_consensus.cc:2468] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b5cd1b7e2a749d2884a860ac710d91c in term 0.
I20260201 21:08:01.065531 5638 leader_election.cc:304] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5cd1b7e2a749d2884a860ac710d91c, 222cd7cd7773481f85566446045798b6; no voters:
I20260201 21:08:01.065657 5877 raft_consensus.cc:2804] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260201 21:08:01.065702 5877 raft_consensus.cc:493] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260201 21:08:01.065722 5877 raft_consensus.cc:3060] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:01.066295 5877 raft_consensus.cc:515] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.066401 5877 leader_election.cc:290] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [CANDIDATE]: Term 1 election: Requested vote from peers 966da8b0bd06448c8cdc4208539e768d (127.4.125.67:39385), 222cd7cd7773481f85566446045798b6 (127.4.125.66:36087)
I20260201 21:08:01.066525 5825 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a696f194b248477f9b0effd98feef0d9" candidate_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966da8b0bd06448c8cdc4208539e768d"
I20260201 21:08:01.066535 5750 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a696f194b248477f9b0effd98feef0d9" candidate_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "222cd7cd7773481f85566446045798b6"
I20260201 21:08:01.066594 5825 raft_consensus.cc:3060] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:01.066605 5750 raft_consensus.cc:3060] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:01.067229 5825 raft_consensus.cc:2468] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b5cd1b7e2a749d2884a860ac710d91c in term 1.
I20260201 21:08:01.067229 5750 raft_consensus.cc:2468] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b5cd1b7e2a749d2884a860ac710d91c in term 1.
I20260201 21:08:01.067422 5637 leader_election.cc:304] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b5cd1b7e2a749d2884a860ac710d91c, 966da8b0bd06448c8cdc4208539e768d; no voters:
I20260201 21:08:01.067516 5877 raft_consensus.cc:2804] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:08:01.067643 5877 raft_consensus.cc:697] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Becoming Leader. State: Replica: 1b5cd1b7e2a749d2884a860ac710d91c, State: Running, Role: LEADER
I20260201 21:08:01.067695 5877 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.068149 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b5cd1b7e2a749d2884a860ac710d91c (127.4.125.65). New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: UNKNOWN } } }
I20260201 21:08:01.122319 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 21:08:01.122319 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260201 21:08:01.122586 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:08:01.122690 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260201 21:08:01.139786 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.140100 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260201 21:08:01.140125 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260201 21:08:01.140256 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:08:01.140317 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260201 21:08:01.140837 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.140903 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.140918 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.19: config changed from index -1 to 19, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.141829 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index -1 to 19, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.142143 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.142509 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
W20260201 21:08:01.142699 5571 catalog_manager.cc:5332] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 19: no extra replica candidate found for tablet a696f194b248477f9b0effd98feef0d9 (table test-workload [id=48887d94874049e5986ea0b349e76ac3]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260201 21:08:01.142831 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:08:01.142884 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260201 21:08:01.143046 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260201 21:08:01.143388 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.143499 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.143672 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.144351 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 19 to 20, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.144757 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.145056 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260201 21:08:01.145056 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260201 21:08:01.145263 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:08:01.145329 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260201 21:08:01.145824 5877 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.145927 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.145951 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.146644 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 20 to 21, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.147034 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.147469 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260201 21:08:01.147559 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260201 21:08:01.147632 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:08:01.147711 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260201 21:08:01.148118 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.148236 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.148322 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.149029 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 21 to 22, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.149132 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.149643 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260201 21:08:01.149780 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260201 21:08:01.149896 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260201 21:08:01.149981 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260201 21:08:01.150353 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.150471 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.151082 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.151083 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 22 to 23, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.151153 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.151486 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260201 21:08:01.151602 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260201 21:08:01.151842 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260201 21:08:01.152057 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260201 21:08:01.152204 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.152292 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.152630 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.153270 5568 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 23 to 24, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.153352 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.153666 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260201 21:08:01.153687 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260201 21:08:01.153906 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260201 21:08:01.153980 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260201 21:08:01.154422 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.154543 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.154567 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.155329 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 24 to 25, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.155555 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.155836 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260201 21:08:01.155998 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260201 21:08:01.156147 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260201 21:08:01.156286 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260201 21:08:01.156499 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.156590 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.156738 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.157362 5568 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 reported cstate change: config changed from index 25 to 26, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.157578 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.157888 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260201 21:08:01.158058 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260201 21:08:01.158196 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260201 21:08:01.158254 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260201 21:08:01.158697 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.158797 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.158839 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.159551 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 26 to 27, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.159968 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.160266 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260201 21:08:01.160243 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260201 21:08:01.160444 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260201 21:08:01.160508 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260201 21:08:01.160914 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.161003 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.161008 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.161814 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.161787 5568 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 27 to 28, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.162142 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260201 21:08:01.162150 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260201 21:08:01.162292 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260201 21:08:01.162395 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260201 21:08:01.162803 5877 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.162902 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.163475 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.163632 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 28 to 29, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.163730 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.164222 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260201 21:08:01.164398 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260201 21:08:01.164534 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260201 21:08:01.164674 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260201 21:08:01.164815 5877 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.164912 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.165673 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 reported cstate change: config changed from index 29 to 30, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.165697 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.165966 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260201 21:08:01.166013 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.166213 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260201 21:08:01.166963 5824 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260201 21:08:01.167253 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260201 21:08:01.167693 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.167785 5824 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.168402 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 30 to 31, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.168510 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.168735 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.169263 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260201 21:08:01.169458 5907 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260201 21:08:01.169710 5824 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260201 21:08:01.169919 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260201 21:08:01.170058 5882 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.170148 5824 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.170814 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.170840 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 31 to 32, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.170853 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.171317 5824 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260201 21:08:01.171495 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260201 21:08:01.171747 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260201 21:08:01.171836 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260201 21:08:01.172197 5555 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 19: aborting the task: latest config opid_index 32; task opid_index 19
I20260201 21:08:01.172297 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.172408 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.173123 5824 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.173224 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 reported cstate change: config changed from index 32 to 33, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.173283 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.173652 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260201 21:08:01.173832 5907 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260201 21:08:01.174152 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260201 21:08:01.174335 5907 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260201 21:08:01.174690 5877 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.174990 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.175642 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.175765 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 33 to 34, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.176442 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.176733 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260201 21:08:01.176764 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260201 21:08:01.176905 5908 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260201 21:08:01.177011 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260201 21:08:01.177529 5908 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.177614 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.178270 5568 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 34 to 35, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.178344 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.178524 5558 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 25: aborting the task: latest config opid_index 34; task opid_index 25
I20260201 21:08:01.179075 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.179410 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260201 21:08:01.179572 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260201 21:08:01.179559 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260201 21:08:01.179750 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260201 21:08:01.180037 5907 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.180160 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.180277 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.180873 5571 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d reported cstate change: config changed from index 35 to 36, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.181396 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 36, Committed index: 36, Last appended: 1.36, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.181668 5749 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20260201 21:08:01.181692 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 36. Preceding OpId from leader: term: 1 index: 37. (index mismatch)
I20260201 21:08:01.181804 5906 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260201 21:08:01.181901 5882 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 37, Last known committed idx: 36, Time since last communication: 0.000s
I20260201 21:08:01.182367 5906 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.182565 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.183149 5568 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c reported cstate change: config changed from index 36 to 37, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.183159 5749 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Committing config change with OpId 1.37: config changed from index 36 to 37, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from VOTER to NON_VOTER. New config: { opid_index: 37 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: NON_VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.183533 5674 consensus_queue.cc:237] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 37, Committed index: 37, Last appended: 1.37, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.183946 5750 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 LEARNER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 37. Preceding OpId from leader: term: 1 index: 38. (index mismatch)
I20260201 21:08:01.184078 5825 raft_consensus.cc:1275] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Refusing update from remote peer 1b5cd1b7e2a749d2884a860ac710d91c: Log matching property violated. Preceding OpId in replica: term: 1 index: 37. Preceding OpId from leader: term: 1 index: 38. (index mismatch)
I20260201 21:08:01.184140 5877 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20260201 21:08:01.184269 5907 consensus_queue.cc:1048] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [LEADER]: Connected to new peer: Peer: permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 38, Last known committed idx: 37, Time since last communication: 0.000s
I20260201 21:08:01.184656 5877 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.184751 5750 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.184859 5825 raft_consensus.cc:2955] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Committing config change with OpId 1.38: config changed from index 37 to 38, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New config: { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.185545 4597 timestamp_advancement-itest.cc:267] GCing logs...
I20260201 21:08:01.185606 4597 log_reader.cc:385] T a696f194b248477f9b0effd98feef0d9: removed 1 log segments from log reader
I20260201 21:08:01.185577 5570 catalog_manager.cc:5654] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 reported cstate change: config changed from index 37 to 38, 222cd7cd7773481f85566446045798b6 (127.4.125.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" committed_config { opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } } }
I20260201 21:08:01.185632 4597 log.cc:1079] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Deleting log segment in path: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root/wals/a696f194b248477f9b0effd98feef0d9/wal-000000001 (ops 1-18)
I20260201 21:08:01.186385 4597 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260201 21:08:01.186445 4597 master.cc:561] Master@127.4.125.126:35415 shutting down...
I20260201 21:08:01.188688 5558 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 23: aborting the task: latest config opid_index 38; task opid_index 23
I20260201 21:08:01.189829 5558 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 21: aborting the task: latest config opid_index 38; task opid_index 21
I20260201 21:08:01.190961 5558 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 31: aborting the task: latest config opid_index 38; task opid_index 31
I20260201 21:08:01.206861 5557 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 27: aborting the task: latest config opid_index 38; task opid_index 27
I20260201 21:08:01.225416 5555 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 29: aborting the task: latest config opid_index 38; task opid_index 29
I20260201 21:08:01.230181 5558 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 33: aborting the task: latest config opid_index 38; task opid_index 33
I20260201 21:08:01.236655 5556 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 35: aborting the task: latest config opid_index 38; task opid_index 35
I20260201 21:08:01.248087 5557 catalog_manager.cc:5201] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet a696f194b248477f9b0effd98feef0d9 with cas_config_opid_index 37: aborting the task: latest config opid_index 38; task opid_index 37
I20260201 21:08:01.253145 4597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.253239 4597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.253269 4597 tablet_replica.cc:333] T 00000000000000000000000000000000 P c593388b8d9946b684913d1b4d74b65a: stopping tablet replica
I20260201 21:08:01.265533 4597 master.cc:583] Master@127.4.125.126:35415 shutdown complete.
I20260201 21:08:01.266621 4597 tablet_server.cc:178] TabletServer@127.4.125.65:0 shutting down...
I20260201 21:08:01.270674 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.270830 4597 tablet_replica.cc:333] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: stopping tablet replica
I20260201 21:08:01.270880 4597 raft_consensus.cc:2243] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.270931 4597 raft_consensus.cc:2272] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.282938 4597 tablet_server.cc:195] TabletServer@127.4.125.65:0 shutdown complete.
I20260201 21:08:01.283746 4597 tablet_server.cc:178] TabletServer@127.4.125.66:0 shutting down...
I20260201 21:08:01.294931 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.295096 4597 tablet_replica.cc:333] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6: stopping tablet replica
I20260201 21:08:01.295132 4597 raft_consensus.cc:2243] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:01.295223 4597 raft_consensus.cc:2272] T a696f194b248477f9b0effd98feef0d9 P 222cd7cd7773481f85566446045798b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.296644 4597 tablet_server.cc:195] TabletServer@127.4.125.66:0 shutdown complete.
I20260201 21:08:01.297250 4597 tablet_server.cc:178] TabletServer@127.4.125.67:0 shutting down...
I20260201 21:08:01.324798 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.324924 4597 tablet_replica.cc:333] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d: stopping tablet replica
I20260201 21:08:01.324982 4597 raft_consensus.cc:2243] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:01.325039 4597 raft_consensus.cc:2272] T a696f194b248477f9b0effd98feef0d9 P 966da8b0bd06448c8cdc4208539e768d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.336966 4597 tablet_server.cc:195] TabletServer@127.4.125.67:0 shutdown complete.
I20260201 21:08:01.337719 4597 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260201 21:08:01.337831 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.338780 5909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.338861 5912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.338948 5910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.339092 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.339176 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.339208 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.339224 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081339224 us; error 0 us; skew 500 ppm
I20260201 21:08:01.339685 4597 webserver.cc:492] Webserver started at http://127.4.125.65:42073/ using document root <none> and password file <none>
I20260201 21:08:01.339761 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.339800 4597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 21:08:01.340389 4597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.341563 5919 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.341693 4597 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:01.341739 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "1b5cd1b7e2a749d2884a860ac710d91c"
format_stamp: "Formatted at 2026-02-01 21:08:00 on dist-test-slave-cnth"
I20260201 21:08:01.341794 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5428
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.369097 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.369366 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.369527 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:01.370165 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 21:08:01.370198 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:01.370574 4597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 21:08:01.370620 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.370620 5926 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Bootstrap starting.
I20260201 21:08:01.372285 5926 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 21:08:01.372493 5926 tablet_bootstrap.cc:492] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Bootstrap complete.
I20260201 21:08:01.372604 5926 ts_tablet_manager.cc:1403] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260201 21:08:01.372720 5926 raft_consensus.cc:359] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.372783 5926 raft_consensus.cc:740] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b5cd1b7e2a749d2884a860ac710d91c, State: Initialized, Role: FOLLOWER
I20260201 21:08:01.372829 5926 consensus_queue.cc:260] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 38, Last appended: 1.38, Last appended by leader: 38, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 38 OBSOLETE_local: false peers { permanent_uuid: "1b5cd1b7e2a749d2884a860ac710d91c" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 42801 } } peers { permanent_uuid: "966da8b0bd06448c8cdc4208539e768d" member_type: VOTER last_known_addr { host: "127.4.125.67" port: 39385 } } peers { permanent_uuid: "222cd7cd7773481f85566446045798b6" member_type: VOTER last_known_addr { host: "127.4.125.66" port: 36087 } }
I20260201 21:08:01.372972 5926 ts_tablet_manager.cc:1434] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260201 21:08:01.373720 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:42801
I20260201 21:08:01.375626 5985 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:42801 every 8 connection(s)
W20260201 21:08:01.376276 5986 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260201 21:08:01.380179 5939 tablet_service.cc:3012] Rejecting scan request for tablet a696f194b248477f9b0effd98feef0d9: Uninitialized: clean time has not yet been initialized
I20260201 21:08:01.380375 4597 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260201 21:08:01.380625 4597 tablet_server.cc:178] TabletServer@127.4.125.65:42801 shutting down...
I20260201 21:08:01.626076 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.626309 4597 tablet_replica.cc:333] stopping tablet replica
I20260201 21:08:01.626369 4597 raft_consensus.cc:2243] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260201 21:08:01.626420 4597 raft_consensus.cc:2272] T a696f194b248477f9b0effd98feef0d9 P 1b5cd1b7e2a749d2884a860ac710d91c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.637842 4597 tablet_server.cc:195] TabletServer@127.4.125.65:42801 shutdown complete.
[ OK ] TimestampAdvancementITest.Kudu2463Test (949 ms)
[ RUN ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260201 21:08:01.642027 4597 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260201 21:08:01.642148 4597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.125.126:33767
I20260201 21:08:01.642266 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.643213 5990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.643334 5991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.643347 5993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.643488 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.643572 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.643610 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.643633 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081643634 us; error 0 us; skew 500 ppm
I20260201 21:08:01.644130 4597 webserver.cc:492] Webserver started at http://127.4.125.126:33179/ using document root <none> and password file <none>
I20260201 21:08:01.644191 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.644223 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:01.644248 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:01.644469 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root/instance:
uuid: "5f45849c993b4874bedc576bdc75a56b"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.645251 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:01.645637 5998 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.645751 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.645792 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
uuid: "5f45849c993b4874bedc576bdc75a56b"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.645840 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.675683 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.675845 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.678164 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.126:33767
I20260201 21:08:01.678642 6050 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.126:33767 every 8 connection(s)
I20260201 21:08:01.678764 6051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:01.679569 6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Bootstrap starting.
I20260201 21:08:01.679783 6051 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:01.680161 6051 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: No bootstrap required, opened a new log
I20260201 21:08:01.680248 6051 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.680284 6051 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:01.680295 6051 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f45849c993b4874bedc576bdc75a56b, State: Initialized, Role: FOLLOWER
I20260201 21:08:01.680326 6051 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.680367 6051 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:08:01.680389 6051 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:08:01.680413 6051 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:01.680801 6051 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.680846 6051 leader_election.cc:304] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f45849c993b4874bedc576bdc75a56b; no voters:
I20260201 21:08:01.680918 6051 leader_election.cc:290] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 21:08:01.680985 6054 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:08:01.681051 6051 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: configured and running, proceeding with master startup.
I20260201 21:08:01.681130 6054 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 LEADER]: Becoming Leader. State: Replica: 5f45849c993b4874bedc576bdc75a56b, State: Running, Role: LEADER
I20260201 21:08:01.681195 6054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.681388 6056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f45849c993b4874bedc576bdc75a56b. Latest consensus state: current_term: 1 leader_uuid: "5f45849c993b4874bedc576bdc75a56b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER } }
I20260201 21:08:01.681375 6055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f45849c993b4874bedc576bdc75a56b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER } }
I20260201 21:08:01.681447 6056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:01.681454 6055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:01.681586 6060 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 21:08:01.681701 6060 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 21:08:01.682142 6060 catalog_manager.cc:1357] Generated new cluster ID: 49e4c8e139e64fc8b63151757f88d9b6
I20260201 21:08:01.682191 6060 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 21:08:01.682250 4597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 21:08:01.716882 6060 catalog_manager.cc:1380] Generated new certificate authority record
I20260201 21:08:01.717268 6060 catalog_manager.cc:1514] Loading token signing keys...
I20260201 21:08:01.724476 6060 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Generated new TSK 0
I20260201 21:08:01.724550 6060 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 21:08:01.746022 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.747138 6073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.747150 6072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.747259 6075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.747259 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.747479 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.747515 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.747527 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081747528 us; error 0 us; skew 500 ppm
I20260201 21:08:01.747988 4597 webserver.cc:492] Webserver started at http://127.4.125.65:35155/ using document root <none> and password file <none>
I20260201 21:08:01.748055 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.748097 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:01.748154 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:01.748420 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root/instance:
uuid: "9287e2d1d5434ec9ae74f7362713a546"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.749226 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:08:01.749647 6080 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.749784 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.749822 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "9287e2d1d5434ec9ae74f7362713a546"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.749863 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.755910 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.756053 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.756167 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:01.756318 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:01.756343 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.756367 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:01.756393 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.758909 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:33941
I20260201 21:08:01.758955 6143 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:33941 every 8 connection(s)
I20260201 21:08:01.761538 6144 heartbeater.cc:344] Connected to a master server at 127.4.125.126:33767
I20260201 21:08:01.761595 6144 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:01.761680 6144 heartbeater.cc:507] Master 127.4.125.126:33767 requested a full tablet report, sending...
I20260201 21:08:01.761873 6015 ts_manager.cc:194] Registered new tserver with Master: 9287e2d1d5434ec9ae74f7362713a546 (127.4.125.65:33941)
I20260201 21:08:01.762331 4597 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.003281747s
I20260201 21:08:01.762374 6015 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51772
I20260201 21:08:01.771831 6015 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51796:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260201 21:08:01.775520 6108 tablet_service.cc:1505] Processing CreateTablet for tablet ecbf3517e58647a5b54d1b3da5b8b33a (DEFAULT_TABLE table=test-workload [id=fb8298d7526c4b3a8e5e710ef7a9e21e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260201 21:08:01.775604 6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbf3517e58647a5b54d1b3da5b8b33a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260201 21:08:01.776635 6162 tablet_bootstrap.cc:492] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Bootstrap starting.
I20260201 21:08:01.776898 6162 tablet_bootstrap.cc:654] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Neither blocks nor log segments found. Creating new log.
I20260201 21:08:01.777318 6162 tablet_bootstrap.cc:492] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: No bootstrap required, opened a new log
I20260201 21:08:01.777355 6162 ts_tablet_manager.cc:1403] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:01.777480 6162 raft_consensus.cc:359] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.777520 6162 raft_consensus.cc:385] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260201 21:08:01.777542 6162 raft_consensus.cc:740] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9287e2d1d5434ec9ae74f7362713a546, State: Initialized, Role: FOLLOWER
I20260201 21:08:01.777593 6162 consensus_queue.cc:260] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.777628 6162 raft_consensus.cc:399] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:08:01.777654 6162 raft_consensus.cc:493] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:08:01.777681 6162 raft_consensus.cc:3060] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 0 FOLLOWER]: Advancing to term 1
I20260201 21:08:01.778183 6162 raft_consensus.cc:515] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.778239 6162 leader_election.cc:304] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9287e2d1d5434ec9ae74f7362713a546; no voters:
I20260201 21:08:01.778335 6162 leader_election.cc:290] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260201 21:08:01.778383 6164 raft_consensus.cc:2804] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Leader election won for term 1
I20260201 21:08:01.778465 6162 ts_tablet_manager.cc:1434] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:01.778506 6144 heartbeater.cc:499] Master 127.4.125.126:33767 was elected leader, sending a full tablet report...
I20260201 21:08:01.778520 6164 raft_consensus.cc:697] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 LEADER]: Becoming Leader. State: Replica: 9287e2d1d5434ec9ae74f7362713a546, State: Running, Role: LEADER
I20260201 21:08:01.778683 6164 consensus_queue.cc:237] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.779106 6015 catalog_manager.cc:5654] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9287e2d1d5434ec9ae74f7362713a546 (127.4.125.65). New cstate: current_term: 1 leader_uuid: "9287e2d1d5434ec9ae74f7362713a546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.781575 4597 tablet_server.cc:178] TabletServer@127.4.125.65:0 shutting down...
I20260201 21:08:01.783516 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.783660 4597 tablet_replica.cc:333] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: stopping tablet replica
I20260201 21:08:01.783738 4597 raft_consensus.cc:2243] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.783778 4597 raft_consensus.cc:2272] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.795325 4597 tablet_server.cc:195] TabletServer@127.4.125.65:0 shutdown complete.
I20260201 21:08:01.796032 4597 master.cc:561] Master@127.4.125.126:33767 shutting down...
I20260201 21:08:01.798187 4597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.798234 4597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.798292 4597 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: stopping tablet replica
I20260201 21:08:01.809719 4597 master.cc:583] Master@127.4.125.126:33767 shutdown complete.
I20260201 21:08:01.810930 4597 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260201 21:08:01.811064 4597 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.125.126:44583
I20260201 21:08:01.811163 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.811972 6169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.811996 6170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.812040 6172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.812202 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.812326 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.812356 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.812368 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081812369 us; error 0 us; skew 500 ppm
I20260201 21:08:01.812811 4597 webserver.cc:492] Webserver started at http://127.4.125.126:41615/ using document root <none> and password file <none>
I20260201 21:08:01.812870 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.812911 4597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 21:08:01.813431 4597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260201 21:08:01.813840 6177 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.813949 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.813992 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
uuid: "5f45849c993b4874bedc576bdc75a56b"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.814023 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.826186 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.826304 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.828444 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.126:44583
I20260201 21:08:01.829298 6229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.126:44583 every 8 connection(s)
I20260201 21:08:01.829689 6230 sys_catalog.cc:263] Verifying existing consensus state
I20260201 21:08:01.829965 6230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Bootstrap starting.
I20260201 21:08:01.831023 6230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 21:08:01.831178 6230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Bootstrap complete.
I20260201 21:08:01.831300 6230 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.831334 6230 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f45849c993b4874bedc576bdc75a56b, State: Initialized, Role: FOLLOWER
I20260201 21:08:01.831362 6230 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.831399 6230 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:08:01.831434 6230 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:08:01.831449 6230 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:08:01.831835 6230 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.831877 6230 leader_election.cc:304] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f45849c993b4874bedc576bdc75a56b; no voters:
I20260201 21:08:01.831946 6230 leader_election.cc:290] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260201 21:08:01.832012 6233 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 2 FOLLOWER]: Leader election won for term 2
I20260201 21:08:01.832083 6230 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: configured and running, proceeding with master startup.
I20260201 21:08:01.832123 6233 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 2 LEADER]: Becoming Leader. State: Replica: 5f45849c993b4874bedc576bdc75a56b, State: Running, Role: LEADER
I20260201 21:08:01.832182 6233 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER }
I20260201 21:08:01.832387 6234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5f45849c993b4874bedc576bdc75a56b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER } }
I20260201 21:08:01.832490 6234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:01.832409 6235 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f45849c993b4874bedc576bdc75a56b. Latest consensus state: current_term: 2 leader_uuid: "5f45849c993b4874bedc576bdc75a56b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f45849c993b4874bedc576bdc75a56b" member_type: VOTER } }
I20260201 21:08:01.832695 6241 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260201 21:08:01.832713 6235 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [sys.catalog]: This master's current role is: LEADER
I20260201 21:08:01.832955 6241 catalog_manager.cc:679] Loaded metadata for table test-workload [id=fb8298d7526c4b3a8e5e710ef7a9e21e]
I20260201 21:08:01.833084 6241 tablet_loader.cc:96] loaded metadata for tablet ecbf3517e58647a5b54d1b3da5b8b33a (table test-workload [id=fb8298d7526c4b3a8e5e710ef7a9e21e])
I20260201 21:08:01.833132 6241 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260201 21:08:01.833235 6241 catalog_manager.cc:1269] Loaded cluster ID: 49e4c8e139e64fc8b63151757f88d9b6
I20260201 21:08:01.833267 6241 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260201 21:08:01.833319 4597 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260201 21:08:01.833954 6241 catalog_manager.cc:1514] Loading token signing keys...
I20260201 21:08:01.834061 6241 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b: Loaded TSK: 0
I20260201 21:08:01.834163 6241 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260201 21:08:01.834513 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.835330 6250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.835340 6251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.835347 6253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.835588 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.835660 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.835687 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.835709 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081835709 us; error 0 us; skew 500 ppm
I20260201 21:08:01.836064 4597 webserver.cc:492] Webserver started at http://127.4.125.65:40331/ using document root <none> and password file <none>
I20260201 21:08:01.836153 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.836192 4597 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260201 21:08:01.836606 4597 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.836941 6258 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.837023 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.837060 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
uuid: "9287e2d1d5434ec9ae74f7362713a546"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.837095 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.841940 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.842089 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.842199 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:01.842415 6265 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260201 21:08:01.842842 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260201 21:08:01.842875 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260201 21:08:01.842905 4597 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260201 21:08:01.843240 4597 ts_tablet_manager.cc:616] Registered 1 tablets
I20260201 21:08:01.843281 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.843288 6265 tablet_bootstrap.cc:492] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Bootstrap starting.
I20260201 21:08:01.844188 6265 tablet_bootstrap.cc:492] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260201 21:08:01.844379 6265 tablet_bootstrap.cc:492] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Bootstrap complete.
I20260201 21:08:01.844480 6265 ts_tablet_manager.cc:1403] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:01.844602 6265 raft_consensus.cc:359] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.844643 6265 raft_consensus.cc:740] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9287e2d1d5434ec9ae74f7362713a546, State: Initialized, Role: FOLLOWER
I20260201 21:08:01.844698 6265 consensus_queue.cc:260] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.844734 6265 raft_consensus.cc:399] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260201 21:08:01.844760 6265 raft_consensus.cc:493] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260201 21:08:01.844812 6265 raft_consensus.cc:3060] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 1 FOLLOWER]: Advancing to term 2
I20260201 21:08:01.845304 6265 raft_consensus.cc:515] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.845355 6265 leader_election.cc:304] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9287e2d1d5434ec9ae74f7362713a546; no voters:
I20260201 21:08:01.845451 6265 leader_election.cc:290] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260201 21:08:01.845506 6307 raft_consensus.cc:2804] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 2 FOLLOWER]: Leader election won for term 2
I20260201 21:08:01.845569 6265 ts_tablet_manager.cc:1434] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260201 21:08:01.845594 6307 raft_consensus.cc:697] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 2 LEADER]: Becoming Leader. State: Replica: 9287e2d1d5434ec9ae74f7362713a546, State: Running, Role: LEADER
I20260201 21:08:01.845659 6307 consensus_queue.cc:237] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } }
I20260201 21:08:01.846452 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.65:33859
I20260201 21:08:01.846484 6328 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.65:33859 every 8 connection(s)
I20260201 21:08:01.846719 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.847559 6333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.847569 6334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.848017 6336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.848254 4597 server_base.cc:1060] running on GCE node
I20260201 21:08:01.848354 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.848384 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.848405 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081848405 us; error 0 us; skew 500 ppm
I20260201 21:08:01.848902 4597 webserver.cc:492] Webserver started at http://127.4.125.66:37689/ using document root <none> and password file <none>
I20260201 21:08:01.848980 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.849016 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:01.849050 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:01.849308 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-1-root/instance:
uuid: "8a76581bf8a841d28a07c9009d4f474e"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.849787 6329 heartbeater.cc:344] Connected to a master server at 127.4.125.126:44583
I20260201 21:08:01.849856 6329 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:01.849915 6329 heartbeater.cc:507] Master 127.4.125.126:44583 requested a full tablet report, sending...
I20260201 21:08:01.850124 6194 ts_manager.cc:194] Registered new tserver with Master: 9287e2d1d5434ec9ae74f7362713a546 (127.4.125.65:33859)
I20260201 21:08:01.850193 6194 catalog_manager.cc:5654] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9287e2d1d5434ec9ae74f7362713a546" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9287e2d1d5434ec9ae74f7362713a546" member_type: VOTER last_known_addr { host: "127.4.125.65" port: 33941 } health_report { overall_health: HEALTHY } } }
I20260201 21:08:01.850231 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260201 21:08:01.850677 6342 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.850761 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.850798 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-1-root
uuid: "8a76581bf8a841d28a07c9009d4f474e"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.850831 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.851226 6194 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60586
I20260201 21:08:01.851558 6329 heartbeater.cc:499] Master 127.4.125.126:44583 was elected leader, sending a full tablet report...
I20260201 21:08:01.857743 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.857895 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.857993 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:01.858104 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:01.858124 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.858140 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:01.858155 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.860888 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.66:41811
I20260201 21:08:01.860916 6405 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.66:41811 every 8 connection(s)
I20260201 21:08:01.861177 4597 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260201 21:08:01.861959 6409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260201 21:08:01.862016 6410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.862308 4597 server_base.cc:1060] running on GCE node
W20260201 21:08:01.862717 6412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260201 21:08:01.862893 4597 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260201 21:08:01.862932 4597 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260201 21:08:01.862946 4597 hybrid_clock.cc:648] HybridClock initialized: now 1769980081862947 us; error 0 us; skew 500 ppm
I20260201 21:08:01.863399 4597 webserver.cc:492] Webserver started at http://127.4.125.67:42189/ using document root <none> and password file <none>
I20260201 21:08:01.863464 4597 fs_manager.cc:362] Metadata directory not provided
I20260201 21:08:01.863509 4597 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260201 21:08:01.863554 4597 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260201 21:08:01.863811 4597 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-2-root/instance:
uuid: "982f762909fe4f2595bc70cfe0485335"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.863969 6406 heartbeater.cc:344] Connected to a master server at 127.4.125.126:44583
I20260201 21:08:01.864022 6406 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:01.864107 6406 heartbeater.cc:507] Master 127.4.125.126:44583 requested a full tablet report, sending...
I20260201 21:08:01.864280 6194 ts_manager.cc:194] Registered new tserver with Master: 8a76581bf8a841d28a07c9009d4f474e (127.4.125.66:41811)
I20260201 21:08:01.864732 6194 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60598
I20260201 21:08:01.864740 4597 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260201 21:08:01.865203 6417 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.865304 4597 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.865350 4597 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-2-root
uuid: "982f762909fe4f2595bc70cfe0485335"
format_stamp: "Formatted at 2026-02-01 21:08:01 on dist-test-slave-cnth"
I20260201 21:08:01.865391 4597 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvHOeaV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1769980045441201-4597-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260201 21:08:01.890388 4597 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260201 21:08:01.890587 4597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260201 21:08:01.890704 4597 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260201 21:08:01.890853 4597 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260201 21:08:01.890877 4597 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.890905 4597 ts_tablet_manager.cc:616] Registered 0 tablets
I20260201 21:08:01.890929 4597 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260201 21:08:01.893874 4597 rpc_server.cc:307] RPC server started. Bound to: 127.4.125.67:39729
I20260201 21:08:01.893919 6480 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.125.67:39729 every 8 connection(s)
I20260201 21:08:01.896224 6481 heartbeater.cc:344] Connected to a master server at 127.4.125.126:44583
I20260201 21:08:01.896279 6481 heartbeater.cc:461] Registering TS with master...
I20260201 21:08:01.896350 6481 heartbeater.cc:507] Master 127.4.125.126:44583 requested a full tablet report, sending...
I20260201 21:08:01.896539 6194 ts_manager.cc:194] Registered new tserver with Master: 982f762909fe4f2595bc70cfe0485335 (127.4.125.67:39729)
I20260201 21:08:01.896776 6194 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60604
I20260201 21:08:01.897337 4597 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003274039s
I20260201 21:08:01.911494 4597 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260201 21:08:01.911566 4597 tablet_server.cc:178] TabletServer@127.4.125.65:0 shutting down...
I20260201 21:08:01.914434 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.914669 4597 tablet_replica.cc:333] stopping tablet replica
I20260201 21:08:01.914723 4597 raft_consensus.cc:2243] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 2 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.914768 4597 raft_consensus.cc:2272] T ecbf3517e58647a5b54d1b3da5b8b33a P 9287e2d1d5434ec9ae74f7362713a546 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.916906 4597 tablet_server.cc:195] TabletServer@127.4.125.65:0 shutdown complete.
I20260201 21:08:01.917914 4597 tablet_server.cc:178] TabletServer@127.4.125.66:0 shutting down...
I20260201 21:08:01.921365 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.932417 4597 tablet_server.cc:195] TabletServer@127.4.125.66:0 shutdown complete.
I20260201 21:08:01.933120 4597 tablet_server.cc:178] TabletServer@127.4.125.67:0 shutting down...
I20260201 21:08:01.935340 4597 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260201 21:08:01.946382 4597 tablet_server.cc:195] TabletServer@127.4.125.67:0 shutdown complete.
I20260201 21:08:01.947005 4597 master.cc:561] Master@127.4.125.126:44583 shutting down...
I20260201 21:08:01.948993 4597 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 2 LEADER]: Raft consensus shutting down.
I20260201 21:08:01.949043 4597 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5f45849c993b4874bedc576bdc75a56b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260201 21:08:01.949101 4597 tablet_replica.cc:333] stopping tablet replica
I20260201 21:08:01.960711 4597 master.cc:583] Master@127.4.125.126:44583 shutdown complete.
[ OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (322 ms)
[----------] 4 tests from TimestampAdvancementITest (36519 ms total)
[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (36519 ms total)
[ PASSED ] 3 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
1 FAILED TEST
I20260201 21:08:01.964560 4597 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:5332: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260201 21:08:01.964581 4597 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~1 seconds ago
I20260201 21:08:01.964596 4597 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~4 seconds ago
I20260201 21:08:01.964628 4597 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 562 messages since previous log ~36 seconds ago