[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260319 16:35:38.924968 23293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.191.126:43153
I20260319 16:35:38.925302 23293 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260319 16:35:38.925459 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:35:38.929597 23299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:38.929558 23298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:38.929726 23293 server_base.cc:1060] running on GCE node
W20260319 16:35:38.929813 23301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:38.930096 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:35:38.930145 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:35:38.930174 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938138930174 us; error 0 us; skew 500 ppm
I20260319 16:35:38.931474 23293 webserver.cc:492] Webserver started at http://127.22.191.126:46679/ using document root <none> and password file <none>
I20260319 16:35:38.931640 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:35:38.931691 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:35:38.931916 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:35:38.933117 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/master-0-root/instance:
uuid: "70b52d248f704da49a3d22a9e2128026"
format_stamp: "Formatted at 2026-03-19 16:35:38 on dist-test-slave-qk5m"
I20260319 16:35:38.934370 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260319 16:35:38.935098 23306 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:38.935323 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:35:38.935387 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/master-0-root
uuid: "70b52d248f704da49a3d22a9e2128026"
format_stamp: "Formatted at 2026-03-19 16:35:38 on dist-test-slave-qk5m"
I20260319 16:35:38.935452 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:35:38.949514 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:35:38.949832 23293 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260319 16:35:38.949940 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:35:38.950313 23312 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260319 16:35:38.954357 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.126:43153
I20260319 16:35:38.954401 23358 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.126:43153 every 8 connection(s)
I20260319 16:35:38.954998 23359 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:35:38.957512 23359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: Bootstrap starting.
I20260319 16:35:38.958355 23359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: Neither blocks nor log segments found. Creating new log.
I20260319 16:35:38.958597 23359 log.cc:826] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: Log is configured to *not* fsync() on all Append() calls
I20260319 16:35:38.959203 23359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: No bootstrap required, opened a new log
I20260319 16:35:38.960608 23359 raft_consensus.cc:359] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER }
I20260319 16:35:38.960726 23359 raft_consensus.cc:385] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:35:38.960762 23359 raft_consensus.cc:740] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70b52d248f704da49a3d22a9e2128026, State: Initialized, Role: FOLLOWER
I20260319 16:35:38.960891 23359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER }
I20260319 16:35:38.960956 23359 raft_consensus.cc:399] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:35:38.960986 23359 raft_consensus.cc:493] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:35:38.961030 23359 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:35:38.961560 23359 raft_consensus.cc:515] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER }
I20260319 16:35:38.961654 23359 leader_election.cc:304] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70b52d248f704da49a3d22a9e2128026; no voters:
I20260319 16:35:38.961827 23359 leader_election.cc:290] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260319 16:35:38.961900 23362 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:35:38.962055 23359 sys_catalog.cc:565] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [sys.catalog]: configured and running, proceeding with master startup.
I20260319 16:35:38.962116 23362 raft_consensus.cc:697] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 1 LEADER]: Becoming Leader. State: Replica: 70b52d248f704da49a3d22a9e2128026, State: Running, Role: LEADER
I20260319 16:35:38.962248 23362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER }
I20260319 16:35:38.962631 23363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70b52d248f704da49a3d22a9e2128026" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER } }
I20260319 16:35:38.962723 23363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [sys.catalog]: This master's current role is: LEADER
I20260319 16:35:38.962920 23370 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260319 16:35:38.962978 23364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70b52d248f704da49a3d22a9e2128026. Latest consensus state: current_term: 1 leader_uuid: "70b52d248f704da49a3d22a9e2128026" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70b52d248f704da49a3d22a9e2128026" member_type: VOTER } }
I20260319 16:35:38.963094 23364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [sys.catalog]: This master's current role is: LEADER
I20260319 16:35:38.963490 23370 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260319 16:35:38.963653 23293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260319 16:35:38.965052 23370 catalog_manager.cc:1357] Generated new cluster ID: d243dda26c5d402d8658c9e625a8a063
I20260319 16:35:38.965099 23370 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260319 16:35:38.979110 23370 catalog_manager.cc:1380] Generated new certificate authority record
I20260319 16:35:38.979662 23370 catalog_manager.cc:1514] Loading token signing keys...
I20260319 16:35:38.987907 23370 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: Generated new TSK 0
I20260319 16:35:38.988114 23370 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260319 16:35:38.995659 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:35:38.995954 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:35:38.997741 23382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:38.997877 23381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:38.997977 23384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:38.998437 23293 server_base.cc:1060] running on GCE node
I20260319 16:35:38.998574 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:35:38.998605 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:35:38.998623 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938138998623 us; error 0 us; skew 500 ppm
I20260319 16:35:38.999400 23293 webserver.cc:492] Webserver started at http://127.22.191.65:35031/ using document root <none> and password file <none>
I20260319 16:35:38.999498 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:35:38.999552 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:35:38.999601 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:35:39.000209 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-0-root/instance:
uuid: "789b0cf57b7649c7b025aebb211c3b29"
format_stamp: "Formatted at 2026-03-19 16:35:38 on dist-test-slave-qk5m"
I20260319 16:35:39.001288 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:35:39.001801 23389 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.002064 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260319 16:35:39.002123 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "789b0cf57b7649c7b025aebb211c3b29"
format_stamp: "Formatted at 2026-03-19 16:35:38 on dist-test-slave-qk5m"
I20260319 16:35:39.002177 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:35:39.027791 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:35:39.028102 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:35:39.028353 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:35:39.028672 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:35:39.028707 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.028746 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:35:39.028771 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.034474 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:39295
I20260319 16:35:39.034611 23452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:39295 every 8 connection(s)
I20260319 16:35:39.034906 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:35:39.035072 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:35:39.036648 23458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:39.036691 23460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:39.037431 23293 server_base.cc:1060] running on GCE node
W20260319 16:35:39.037714 23457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:39.038060 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:35:39.038218 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:35:39.038250 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938139038250 us; error 0 us; skew 500 ppm
I20260319 16:35:39.039268 23293 webserver.cc:492] Webserver started at http://127.22.191.66:37911/ using document root <none> and password file <none>
I20260319 16:35:39.039413 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:35:39.039474 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:35:39.039554 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:35:39.039983 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-1-root/instance:
uuid: "df6bf03d752948d8a51e1ac8ac806839"
format_stamp: "Formatted at 2026-03-19 16:35:39 on dist-test-slave-qk5m"
I20260319 16:35:39.040934 23453 heartbeater.cc:344] Connected to a master server at 127.22.191.126:43153
I20260319 16:35:39.041148 23453 heartbeater.cc:461] Registering TS with master...
I20260319 16:35:39.041380 23453 heartbeater.cc:507] Master 127.22.191.126:43153 requested a full tablet report, sending...
I20260319 16:35:39.042026 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260319 16:35:39.042160 23323 ts_manager.cc:194] Registered new tserver with Master: 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295)
I20260319 16:35:39.042711 23465 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.042838 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260319 16:35:39.042886 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-1-root
uuid: "df6bf03d752948d8a51e1ac8ac806839"
format_stamp: "Formatted at 2026-03-19 16:35:39 on dist-test-slave-qk5m"
I20260319 16:35:39.042928 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:35:39.042994 23323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58480
I20260319 16:35:39.070987 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:35:39.071312 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:35:39.071545 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:35:39.071815 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:35:39.071856 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.071887 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:35:39.071902 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.076459 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.66:38161
I20260319 16:35:39.076519 23529 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.66:38161 every 8 connection(s)
I20260319 16:35:39.076902 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:35:39.077098 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:35:39.078577 23533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:39.078645 23536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:35:39.079057 23534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:35:39.079622 23293 server_base.cc:1060] running on GCE node
I20260319 16:35:39.079820 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:35:39.079864 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:35:39.079882 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938139079883 us; error 0 us; skew 500 ppm
I20260319 16:35:39.080508 23293 webserver.cc:492] Webserver started at http://127.22.191.67:34043/ using document root <none> and password file <none>
I20260319 16:35:39.080631 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:35:39.080701 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:35:39.080760 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:35:39.080911 23530 heartbeater.cc:344] Connected to a master server at 127.22.191.126:43153
I20260319 16:35:39.080972 23530 heartbeater.cc:461] Registering TS with master...
I20260319 16:35:39.081075 23530 heartbeater.cc:507] Master 127.22.191.126:43153 requested a full tablet report, sending...
I20260319 16:35:39.081099 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-2-root/instance:
uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
format_stamp: "Formatted at 2026-03-19 16:35:39 on dist-test-slave-qk5m"
I20260319 16:35:39.081446 23323 ts_manager.cc:194] Registered new tserver with Master: df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.081933 23323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58482
I20260319 16:35:39.082368 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260319 16:35:39.082984 23541 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.083158 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:35:39.083204 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-2-root
uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
format_stamp: "Formatted at 2026-03-19 16:35:39 on dist-test-slave-qk5m"
I20260319 16:35:39.083264 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:35:39.091511 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:35:39.091801 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:35:39.091967 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:35:39.092171 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:35:39.092200 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.092229 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:35:39.092278 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.095901 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.67:39875
I20260319 16:35:39.096074 23604 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.67:39875 every 8 connection(s)
I20260319 16:35:39.099845 23605 heartbeater.cc:344] Connected to a master server at 127.22.191.126:43153
I20260319 16:35:39.099922 23605 heartbeater.cc:461] Registering TS with master...
I20260319 16:35:39.100044 23605 heartbeater.cc:507] Master 127.22.191.126:43153 requested a full tablet report, sending...
I20260319 16:35:39.100402 23323 ts_manager.cc:194] Registered new tserver with Master: e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:39.100771 23293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004578558s
I20260319 16:35:39.100888 23323 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58494
I20260319 16:35:39.118247 23323 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58532:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260319 16:35:39.118561 23323 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260319 16:35:39.124926 23569 tablet_service.cc:1511] Processing CreateTablet for tablet 53746d9ba488446e8cf4a7138ef8ce6f (DEFAULT_TABLE table=test-workload [id=9f9512944ae646f8b7da876e0ada2dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:35:39.125139 23569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53746d9ba488446e8cf4a7138ef8ce6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:35:39.125427 23493 tablet_service.cc:1511] Processing CreateTablet for tablet 53746d9ba488446e8cf4a7138ef8ce6f (DEFAULT_TABLE table=test-workload [id=9f9512944ae646f8b7da876e0ada2dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:35:39.125542 23493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53746d9ba488446e8cf4a7138ef8ce6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:35:39.126822 23626 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Bootstrap starting.
I20260319 16:35:39.127130 23417 tablet_service.cc:1511] Processing CreateTablet for tablet 53746d9ba488446e8cf4a7138ef8ce6f (DEFAULT_TABLE table=test-workload [id=9f9512944ae646f8b7da876e0ada2dbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:35:39.127231 23417 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53746d9ba488446e8cf4a7138ef8ce6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:35:39.127370 23626 tablet_bootstrap.cc:654] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Neither blocks nor log segments found. Creating new log.
I20260319 16:35:39.128007 23626 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: No bootstrap required, opened a new log
I20260319 16:35:39.128064 23626 ts_tablet_manager.cc:1403] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:35:39.128350 23629 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Bootstrap starting.
I20260319 16:35:39.128517 23626 raft_consensus.cc:359] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.128700 23626 raft_consensus.cc:385] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:35:39.128778 23629 tablet_bootstrap.cc:654] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Neither blocks nor log segments found. Creating new log.
I20260319 16:35:39.128778 23626 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Initialized, Role: FOLLOWER
I20260319 16:35:39.128885 23626 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.129089 23626 ts_tablet_manager.cc:1434] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260319 16:35:39.129196 23605 heartbeater.cc:499] Master 127.22.191.126:43153 was elected leader, sending a full tablet report...
I20260319 16:35:39.132428 23627 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Bootstrap starting.
I20260319 16:35:39.132886 23627 tablet_bootstrap.cc:654] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Neither blocks nor log segments found. Creating new log.
I20260319 16:35:39.132910 23629 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: No bootstrap required, opened a new log
I20260319 16:35:39.133225 23629 ts_tablet_manager.cc:1403] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260319 16:35:39.133364 23629 raft_consensus.cc:359] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.133423 23629 raft_consensus.cc:385] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:35:39.133442 23629 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Initialized, Role: FOLLOWER
I20260319 16:35:39.133489 23629 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.133677 23629 ts_tablet_manager.cc:1434] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260319 16:35:39.133724 23453 heartbeater.cc:499] Master 127.22.191.126:43153 was elected leader, sending a full tablet report...
I20260319 16:35:39.136821 23627 tablet_bootstrap.cc:492] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: No bootstrap required, opened a new log
I20260319 16:35:39.136898 23627 ts_tablet_manager.cc:1403] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260319 16:35:39.137037 23627 raft_consensus.cc:359] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.137112 23627 raft_consensus.cc:385] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:35:39.137132 23627 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Initialized, Role: FOLLOWER
I20260319 16:35:39.137193 23627 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.137449 23530 heartbeater.cc:499] Master 127.22.191.126:43153 was elected leader, sending a full tablet report...
I20260319 16:35:39.137590 23627 ts_tablet_manager.cc:1434] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:35:39.168536 23634 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260319 16:35:39.168640 23634 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.168882 23634 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:39.171512 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" is_pre_election: true
I20260319 16:35:39.171512 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29" is_pre_election: true
I20260319 16:35:39.171654 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 0.
I20260319 16:35:39.171653 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 0.
I20260319 16:35:39.171854 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:39.171983 23634 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260319 16:35:39.172062 23634 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:39.172093 23634 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:35:39.173008 23634 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.173167 23634 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 1 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:39.173352 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:39.173417 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:35:39.173444 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.173540 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:35:39.174072 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 1.
I20260319 16:35:39.174256 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters:
I20260319 16:35:39.174342 23634 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:35:39.174512 23634 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:39.174556 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 1.
I20260319 16:35:39.174597 23634 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.175681 23323 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 0 to 1, leader changed from <none> to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 1 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:39.186944 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 1 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260319 16:35:39.187011 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 1 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260319 16:35:39.187404 23644 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:35:39.187533 23636 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:35:39.210749 23293 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260319 16:35:39.494196 23630 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:39.494313 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:35:39.495167 23630 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.495400 23630 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 2 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.498941 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:39.498916 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:39.499239 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:39.499414 23630 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260319 16:35:39.505913 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 1. Current term is 2. Ops: []
I20260319 16:35:39.506314 23671 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
W20260319 16:35:39.506489 23671 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260319 16:35:39.506526 23671 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260319 16:35:39.527925 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:39.528033 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:35:39.528891 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.529106 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 2 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.529807 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 2 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 1. Current term is 2. Ops: []
I20260319 16:35:39.530032 23636 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:39.532003 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:39.532025 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.532135 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 2: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:39.532307 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:39.532431 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260319 16:35:39.548688 23671 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 LEADER]: Stepping down as leader of term 1
I20260319 16:35:39.548873 23671 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:39.548974 23671 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.549134 23671 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:35:39.627624 23630 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:39.627825 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:35:39.628655 23630 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.628852 23630 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 3 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.629077 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:39.629077 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:39.629199 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:35:39.629211 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:35:39.629963 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 3.
I20260319 16:35:39.629963 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 3.
I20260319 16:35:39.630199 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:39.630288 23630 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 FOLLOWER]: Leader election won for term 3
I20260319 16:35:39.630394 23630 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:39.630452 23630 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.631023 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 1 to 3, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 3 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:39.731523 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 3 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 3 index: 42. (index mismatch)
I20260319 16:35:39.731784 23630 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:39.735112 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:39.735183 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:35:39.736057 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.736229 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 4 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.736521 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 4 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.736635 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 4 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:39.736852 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:39.737033 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260319 16:35:39.740227 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 3. Current term is 4. Ops: []
I20260319 16:35:39.740504 23630 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:39.744288 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 3. Current term is 4. Ops: [3.42-3.42]
I20260319 16:35:39.744525 23675 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:39.823997 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 3. Current term is 4. Ops: [3.42-3.42]
I20260319 16:35:39.824404 23674 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:39.833719 23671 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:39.833832 23671 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:35:39.834512 23671 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.834653 23671 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 4 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:39.835027 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.835031 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:39.835161 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 4: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:39.835304 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:39.835436 23671 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260319 16:35:39.847975 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 4 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 3. Current term is 4. Ops: []
I20260319 16:35:39.848403 23675 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260319 16:35:39.854342 23630 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 LEADER]: Stepping down as leader of term 3
I20260319 16:35:39.854447 23630 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:39.854530 23630 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.854643 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:35:39.906563 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:39.906665 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:35:39.907421 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.907593 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 5 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:39.907920 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 5 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.907920 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 5 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:39.908053 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:35:39.908059 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:35:39.908838 23503 raft_consensus.cc:2410] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 for term 5 because replica has last-logged OpId of term: 3 index: 42, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 41.
I20260319 16:35:39.908891 23579 raft_consensus.cc:2410] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 for term 5 because replica has last-logged OpId of term: 3 index: 42, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 41.
I20260319 16:35:39.909140 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:39.909246 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260319 16:35:39.984637 23671 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:39.984750 23671 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:35:39.985538 23671 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.985693 23671 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 6 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:39.986088 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 6 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:39.986088 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 6 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:39.986224 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:35:39.986230 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:35:39.986984 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 6.
I20260319 16:35:39.986984 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 6.
I20260319 16:35:39.987255 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters:
I20260319 16:35:39.987396 23671 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 FOLLOWER]: Leader election won for term 6
I20260319 16:35:39.987474 23671 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:39.987517 23671 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:39.988175 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 3 to 6, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 6 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:40.071532 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 6 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 6 index: 43. (index mismatch)
I20260319 16:35:40.071844 23671 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 41, Time since last communication: 0.000s
I20260319 16:35:40.088894 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 6 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 3 index: 42. Preceding OpId from leader: term: 6 index: 43. (index mismatch)
I20260319 16:35:40.089250 23671 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260319 16:35:40.173358 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 6 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:40.173471 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:35:40.174226 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.174401 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 7 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:40.174644 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 7 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:40.174656 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 7 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:40.174899 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:40.175057 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260319 16:35:40.182921 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 6. Current term is 7. Ops: []
I20260319 16:35:40.183341 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 6.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260319 16:35:40.190541 23630 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 6 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:40.190649 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:35:40.191417 23630 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.191593 23630 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 7 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:40.191908 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:40.191910 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:40.192054 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 7: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:40.192276 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:40.192458 23630 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260319 16:35:40.200896 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 7 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 6. Current term is 7. Ops: []
I20260319 16:35:40.201210 23671 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 6.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260319 16:35:40.237633 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 LEADER]: Stepping down as leader of term 6
I20260319 16:35:40.237807 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:40.237890 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 6.43, Last appended by leader: 43, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.238101 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:35:40.313654 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:40.313759 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:35:40.314512 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.314692 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 8 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:40.314975 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 8 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:40.315040 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:35:40.315002 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 8 candidate_status { last_received { term: 6 index: 43 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:40.315096 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:35:40.315682 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 8.
I20260319 16:35:40.315798 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 8.
I20260319 16:35:40.316004 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters:
I20260319 16:35:40.316102 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 FOLLOWER]: Leader election won for term 8
I20260319 16:35:40.316205 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:40.316283 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 6.43, Last appended by leader: 43, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.316835 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 6 to 8, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 8 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:40.416900 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 8 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 6 index: 43. Preceding OpId from leader: term: 8 index: 44. (index mismatch)
I20260319 16:35:40.417232 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260319 16:35:40.437309 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 8 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 6 index: 43. Preceding OpId from leader: term: 8 index: 44. (index mismatch)
I20260319 16:35:40.437647 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260319 16:35:40.539041 23630 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:40.539175 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:35:40.539898 23630 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.540081 23630 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 9 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:40.540338 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:40.540338 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:40.540602 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:40.540701 23630 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260319 16:35:40.546932 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 8. Current term is 9. Ops: []
I20260319 16:35:40.547286 23678 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 8.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260319 16:35:40.619028 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:40.619144 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:35:40.619927 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.620118 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 9 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:40.620476 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 9 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:40.620498 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 9 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:40.620594 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 9: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:40.620762 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:40.620882 23676 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260319 16:35:40.633304 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 LEADER]: Stepping down as leader of term 8
I20260319 16:35:40.633414 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:40.633620 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 8.44, Last appended by leader: 44, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.633796 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:35:40.680406 23630 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:40.680531 23630 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:35:40.681260 23630 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.681442 23630 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 10 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:40.681676 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:40.681686 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 44 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:40.681751 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:35:40.681937 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:35:40.682543 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 10.
I20260319 16:35:40.682554 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 10.
I20260319 16:35:40.682816 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:40.682915 23630 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 FOLLOWER]: Leader election won for term 10
I20260319 16:35:40.683023 23630 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:40.683081 23630 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 8.44, Last appended by leader: 44, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.683542 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 8 to 10, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 10 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:40.786412 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 10 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 44. Preceding OpId from leader: term: 10 index: 45. (index mismatch)
I20260319 16:35:40.786732 23630 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260319 16:35:40.790349 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 10 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 44. Preceding OpId from leader: term: 10 index: 45. (index mismatch)
I20260319 16:35:40.790704 23680 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260319 16:35:40.989441 23681 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:40.989559 23681 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:35:40.990314 23681 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:40.990476 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 10. Current term is 11. Ops: []
I20260319 16:35:40.990491 23681 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 11 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:40.990696 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 11 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:40.990813 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 11 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:40.990880 23680 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 10.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260319 16:35:40.991098 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:40.991199 23681 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260319 16:35:41.072116 23680 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 LEADER]: Stepping down as leader of term 10
I20260319 16:35:41.072220 23680 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:41.072327 23680 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 10.45, Last appended by leader: 45, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.072448 23680 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:35:41.078549 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:41.078660 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:35:41.079370 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.079550 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 11 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:41.079861 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 11 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.079874 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 11 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:41.079989 23503 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 11: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:41.080631 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 11.
I20260319 16:35:41.080860 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:41.080950 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 FOLLOWER]: Leader election won for term 11
I20260319 16:35:41.080996 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.081040 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 10.45, Last appended by leader: 45, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.081579 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 10 to 11, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 11 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:41.081873 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.083148 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.085350 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.089586 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.097829 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.110386 23681 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:41.110487 23681 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:35:41.111236 23681 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.111411 23681 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 12 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:41.111687 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 12 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:41.111728 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 12 candidate_status { last_received { term: 10 index: 45 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.111814 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:35:41.112444 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 12.
I20260319 16:35:41.112655 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:41.112833 23681 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 FOLLOWER]: Leader election won for term 12
I20260319 16:35:41.112883 23681 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:41.112938 23681 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 10.45, Last appended by leader: 45, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.113476 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 11 to 12, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 12 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:41.114086 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.146330 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.159806 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 11. Current term is 12. Ops: []
I20260319 16:35:41.160133 23633 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260319 16:35:41.160282 23633 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 12.46 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 45
I20260319 16:35:41.160344 23677 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 LEADER]: Stepping down as leader of term 11
I20260319 16:35:41.160385 23677 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.160447 23677 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 11.46, Last appended by leader: 46, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.160537 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:35:41.210623 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.221467 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 12 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 10 index: 45. Preceding OpId from leader: term: 12 index: 46. (index mismatch)
I20260319 16:35:41.221573 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 12 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 11 index: 46. Preceding OpId from leader: term: 12 index: 46. (term mismatch)
I20260319 16:35:41.221647 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 45
I20260319 16:35:41.221691 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 11.46
I20260319 16:35:41.221731 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:41.221773 23681 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260319 16:35:41.222079 23681 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260319 16:35:41.338918 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.403308 23680 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 12 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:41.403411 23680 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:35:41.404106 23680 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.404309 23680 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 13 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:41.404505 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:41.404505 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:41.404892 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:41.404999 23680 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260319 16:35:41.411134 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 12. Current term is 13. Ops: []
I20260319 16:35:41.411464 23681 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 12.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260319 16:35:41.411600 23681 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 LEADER]: Stepping down as leader of term 12
I20260319 16:35:41.411634 23681 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:41.411685 23681 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 12.46, Last appended by leader: 46, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.411773 23681 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:35:41.448036 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 12 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:41.448154 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:35:41.448899 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.449096 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 13 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:41.449328 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 13 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:41.449332 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 13 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.449476 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 13: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:41.450126 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 13.
I20260319 16:35:41.450350 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:41.450440 23677 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 FOLLOWER]: Leader election won for term 13
I20260319 16:35:41.450493 23677 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.450546 23677 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 12.46, Last appended by leader: 46, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.451089 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 12 to 13, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 13 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:41.534392 23680 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:41.534492 23680 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 13 FOLLOWER]: Advancing to term 14
I20260319 16:35:41.535260 23680 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.535429 23680 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 14 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:41.535687 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:41.535689 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 46 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:41.535812 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 13 FOLLOWER]: Advancing to term 14
I20260319 16:35:41.536413 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 14.
I20260319 16:35:41.536751 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:41.536881 23680 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 FOLLOWER]: Leader election won for term 14
I20260319 16:35:41.536994 23680 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:41.537081 23680 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 12.46, Last appended by leader: 46, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.537586 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 13 to 14, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 14 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:41.538602 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 13. Current term is 14. Ops: []
I20260319 16:35:41.538870 23677 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260319 16:35:41.538954 23677 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 14.47 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 46
I20260319 16:35:41.538986 23677 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 LEADER]: Stepping down as leader of term 13
I20260319 16:35:41.539014 23677 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.539067 23677 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 13.47, Last appended by leader: 47, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.539140 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 13 FOLLOWER]: Advancing to term 14
I20260319 16:35:41.595311 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:41.625361 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 14 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 46. Preceding OpId from leader: term: 14 index: 47. (index mismatch)
I20260319 16:35:41.625669 23680 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260319 16:35:41.626869 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 14 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 47. Preceding OpId from leader: term: 14 index: 47. (term mismatch)
I20260319 16:35:41.626925 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 46
I20260319 16:35:41.626943 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 13.47
I20260319 16:35:41.626959 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:41.627198 23680 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260319 16:35:41.727612 23681 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:41.727726 23681 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 14 FOLLOWER]: Advancing to term 15
I20260319 16:35:41.728508 23681 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.728681 23681 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 15 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:41.728982 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 15 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:41.728971 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 15 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.729245 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:41.729357 23681 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260319 16:35:41.738443 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 14. Current term is 15. Ops: []
I20260319 16:35:41.738723 23683 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 14.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260319 16:35:41.738941 23683 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 LEADER]: Stepping down as leader of term 14
I20260319 16:35:41.738963 23683 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:41.739018 23683 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 14.47, Last appended by leader: 47, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.739105 23683 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 14 FOLLOWER]: Advancing to term 15
I20260319 16:35:41.807519 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:41.807641 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 14 FOLLOWER]: Advancing to term 15
I20260319 16:35:41.808420 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.808604 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 15 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:41.808840 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 15 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.808899 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 15 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:41.809002 23503 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 15: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:41.809465 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 15.
I20260319 16:35:41.809685 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:41.809904 23677 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 FOLLOWER]: Leader election won for term 15
I20260319 16:35:41.809968 23677 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.810012 23677 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 14.47, Last appended by leader: 47, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.810551 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 14 to 15, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 15 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:41.856469 23681 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:41.856585 23681 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 15 FOLLOWER]: Advancing to term 16
I20260319 16:35:41.857331 23681 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.857483 23681 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 16 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:41.857811 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 16 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:41.857883 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 15 FOLLOWER]: Advancing to term 16
I20260319 16:35:41.857841 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 16 candidate_status { last_received { term: 14 index: 47 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:41.858394 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 16.
I20260319 16:35:41.858608 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:41.858716 23681 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 FOLLOWER]: Leader election won for term 16
I20260319 16:35:41.858781 23681 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:41.858829 23681 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 14.47, Last appended by leader: 47, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.859519 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 15 to 16, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 16 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:41.901919 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 15. Current term is 16. Ops: []
I20260319 16:35:41.902209 23677 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260319 16:35:41.902328 23677 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 16.48 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 47
I20260319 16:35:41.902372 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 LEADER]: Stepping down as leader of term 15
I20260319 16:35:41.902442 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:41.902544 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 15.48, Last appended by leader: 48, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:41.902637 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 15 FOLLOWER]: Advancing to term 16
I20260319 16:35:41.952425 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 16 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 14 index: 47. Preceding OpId from leader: term: 16 index: 48. (index mismatch)
I20260319 16:35:41.952796 23681 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260319 16:35:41.954243 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 16 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 15 index: 48. Preceding OpId from leader: term: 16 index: 48. (term mismatch)
I20260319 16:35:41.954306 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 47
I20260319 16:35:41.954324 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 15.48
I20260319 16:35:41.954340 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:41.954486 23684 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260319 16:35:42.054533 23683 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:42.054638 23683 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 16 FOLLOWER]: Advancing to term 17
I20260319 16:35:42.055401 23683 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.055576 23683 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 17 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.055831 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.055876 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.056229 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:42.056354 23683 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260319 16:35:42.070535 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 16. Current term is 17. Ops: []
I20260319 16:35:42.070786 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 16.48, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260319 16:35:42.070933 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 LEADER]: Stepping down as leader of term 16
I20260319 16:35:42.070974 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:42.071043 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 16.48, Last appended by leader: 48, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.071125 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 16 FOLLOWER]: Advancing to term 17
I20260319 16:35:42.107602 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:42.151752 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 16 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:42.151877 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 16 FOLLOWER]: Advancing to term 17
I20260319 16:35:42.152727 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.152923 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 17 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.153196 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 17 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:42.153196 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 17 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.153327 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 17: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:42.153930 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 17.
I20260319 16:35:42.154165 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:42.154294 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 FOLLOWER]: Leader election won for term 17
I20260319 16:35:42.154367 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:42.154430 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 16.48, Last appended by leader: 48, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.154950 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 16 to 17, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 17 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:42.167939 23683 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:42.168067 23683 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 17 FOLLOWER]: Advancing to term 18
I20260319 16:35:42.168990 23683 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.169296 23683 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 18 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.169459 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.169520 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 48 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.169674 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 17 FOLLOWER]: Advancing to term 18
I20260319 16:35:42.170368 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 18.
I20260319 16:35:42.170567 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:42.170671 23683 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 FOLLOWER]: Leader election won for term 18
I20260319 16:35:42.170727 23683 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:42.170778 23683 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 16.48, Last appended by leader: 48, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.171345 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 17 to 18, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 18 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:42.235646 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 18 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 17. Current term is 18. Ops: []
I20260319 16:35:42.236132 23633 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260319 16:35:42.236318 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 LEADER]: Stepping down as leader of term 17
I20260319 16:35:42.236354 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:42.236411 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 17.49, Last appended by leader: 49, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.236483 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 17 FOLLOWER]: Advancing to term 18
I20260319 16:35:42.250842 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 18 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 48. Preceding OpId from leader: term: 18 index: 49. (index mismatch)
I20260319 16:35:42.251245 23683 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260319 16:35:42.252574 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 18 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 49. Preceding OpId from leader: term: 18 index: 49. (term mismatch)
I20260319 16:35:42.252645 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 48
I20260319 16:35:42.252665 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 17.49
I20260319 16:35:42.252682 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:42.252889 23685 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260319 16:35:42.520391 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:42.520500 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 18 FOLLOWER]: Advancing to term 19
I20260319 16:35:42.521287 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.521454 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 19 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.521689 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 19 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:42.521771 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 19 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.521957 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:42.522089 23677 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260319 16:35:42.523090 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:42.523157 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 18 FOLLOWER]: Advancing to term 19
I20260319 16:35:42.523752 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.523876 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 19 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:42.524106 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 19 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:42.524117 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 19 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.524224 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 19: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:42.524395 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:42.524497 23676 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260319 16:35:42.529874 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 19 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 18. Current term is 19. Ops: []
I20260319 16:35:42.530133 23685 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 18.49, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260319 16:35:42.530248 23685 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 LEADER]: Stepping down as leader of term 18
I20260319 16:35:42.530267 23685 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:42.530319 23685 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 18.49, Last appended by leader: 49, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.530397 23685 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 18 FOLLOWER]: Advancing to term 19
I20260319 16:35:42.633594 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:42.633808 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 19 FOLLOWER]: Advancing to term 20
I20260319 16:35:42.634490 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.634663 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 20 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.634915 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 20 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:42.634960 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 20 candidate_status { last_received { term: 18 index: 49 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.635102 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 19 FOLLOWER]: Advancing to term 20
I20260319 16:35:42.635179 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 19 FOLLOWER]: Advancing to term 20
I20260319 16:35:42.635713 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 20.
I20260319 16:35:42.635883 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 20.
I20260319 16:35:42.635953 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:42.636046 23677 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 FOLLOWER]: Leader election won for term 20
I20260319 16:35:42.636083 23677 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:42.636128 23677 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 18.49, Last appended by leader: 49, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.636739 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 18 to 20, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 20 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:42.737352 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 20 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 18 index: 49. Preceding OpId from leader: term: 20 index: 50. (index mismatch)
I20260319 16:35:42.737607 23677 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260319 16:35:42.738798 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 20 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 18 index: 49. Preceding OpId from leader: term: 20 index: 50. (index mismatch)
I20260319 16:35:42.739045 23686 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260319 16:35:42.840301 23680 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:42.840402 23680 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 20 FOLLOWER]: Advancing to term 21
I20260319 16:35:42.841214 23680 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.841398 23680 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 21 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.841658 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 21 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.841696 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 21 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.842108 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:42.842249 23680 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260319 16:35:42.863843 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 20. Current term is 21. Ops: []
I20260319 16:35:42.864166 23633 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 20.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260319 16:35:42.864292 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 LEADER]: Stepping down as leader of term 20
I20260319 16:35:42.864318 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:42.864372 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 20.50, Last appended by leader: 50, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.864454 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 20 FOLLOWER]: Advancing to term 21
I20260319 16:35:42.925577 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:42.925680 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 20 FOLLOWER]: Advancing to term 21
I20260319 16:35:42.926468 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.926633 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 21 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:42.926900 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 21 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:42.926978 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 21: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:42.926921 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 21 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.927634 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 21.
I20260319 16:35:42.927951 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:42.928058 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 FOLLOWER]: Leader election won for term 21
I20260319 16:35:42.928184 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:42.928248 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 20.50, Last appended by leader: 50, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.928849 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 20 to 21, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 21 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:42.962723 23680 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:42.962849 23680 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 21 FOLLOWER]: Advancing to term 22
I20260319 16:35:42.963614 23680 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.963781 23680 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 22 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:42.964010 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 22 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:42.964036 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 22 candidate_status { last_received { term: 20 index: 50 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:42.964134 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 21 FOLLOWER]: Advancing to term 22
I20260319 16:35:42.964785 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 22.
I20260319 16:35:42.965067 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:42.965169 23680 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 FOLLOWER]: Leader election won for term 22
I20260319 16:35:42.965219 23680 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:42.965269 23680 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 20.50, Last appended by leader: 50, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:42.965812 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 21 to 22, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 22 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:43.013387 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 22 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 21. Current term is 22. Ops: []
I20260319 16:35:43.013761 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260319 16:35:43.013892 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 LEADER]: Stepping down as leader of term 21
I20260319 16:35:43.013912 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:43.014063 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 21.51, Last appended by leader: 51, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.014142 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 21 FOLLOWER]: Advancing to term 22
I20260319 16:35:43.052495 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 22 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 21 index: 51. Preceding OpId from leader: term: 22 index: 51. (term mismatch)
I20260319 16:35:43.052590 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 50
I20260319 16:35:43.052611 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 21.51
I20260319 16:35:43.052629 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:43.053089 23680 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260319 16:35:43.054612 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 22 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 20 index: 50. Preceding OpId from leader: term: 22 index: 51. (index mismatch)
I20260319 16:35:43.054957 23688 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260319 16:35:43.107894 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:43.156108 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:43.156214 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 22 FOLLOWER]: Advancing to term 23
I20260319 16:35:43.157009 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.157197 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 23 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:43.157456 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 23 candidate_status { last_received { term: 22 index: 51 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:43.157456 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 23 candidate_status { last_received { term: 22 index: 51 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:43.157650 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 22 FOLLOWER]: Advancing to term 23
I20260319 16:35:43.158238 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 23.
I20260319 16:35:43.158524 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:43.158643 23677 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 FOLLOWER]: Leader election won for term 23
I20260319 16:35:43.158694 23677 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:43.158740 23677 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 22.51, Last appended by leader: 51, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.159265 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 22 to 23, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 23 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:43.164872 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 23 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 22. Current term is 23. Ops: []
I20260319 16:35:43.165208 23688 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 22.51, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260319 16:35:43.165333 23688 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 LEADER]: Stepping down as leader of term 22
I20260319 16:35:43.165369 23688 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:43.165442 23688 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 22.51, Last appended by leader: 51, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.165518 23688 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 22 FOLLOWER]: Advancing to term 23
I20260319 16:35:43.242873 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 23 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 22 index: 51. Preceding OpId from leader: term: 23 index: 52. (index mismatch)
I20260319 16:35:43.243196 23677 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260319 16:35:43.244449 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 23 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 22 index: 51. Preceding OpId from leader: term: 23 index: 52. (index mismatch)
I20260319 16:35:43.244719 23686 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260319 16:35:43.345124 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:43.345237 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 23 FOLLOWER]: Advancing to term 24
I20260319 16:35:43.345942 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.346107 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 24 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:43.346407 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 24 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.346517 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 24 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:43.346722 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:43.346916 23676 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260319 16:35:43.358233 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 23. Current term is 24. Ops: []
I20260319 16:35:43.358548 23677 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 23.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260319 16:35:43.358690 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 LEADER]: Stepping down as leader of term 23
I20260319 16:35:43.358726 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:43.358791 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 23.52, Last appended by leader: 52, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.358888 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 23 FOLLOWER]: Advancing to term 24
I20260319 16:35:43.434455 23685 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 23 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:43.434566 23685 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 23 FOLLOWER]: Advancing to term 24
I20260319 16:35:43.435323 23685 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.435496 23685 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 24 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:43.435739 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 24 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:43.435757 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 24 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.435842 23503 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 24: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:43.436455 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 24.
I20260319 16:35:43.436671 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:43.436836 23685 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 FOLLOWER]: Leader election won for term 24
I20260319 16:35:43.436887 23685 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:43.436928 23685 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 23.52, Last appended by leader: 52, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.437463 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 23 to 24, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 24 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:43.464473 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:43.464588 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 24 FOLLOWER]: Advancing to term 25
I20260319 16:35:43.465528 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.465711 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 25 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:43.465945 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 25 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:43.465945 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 25 candidate_status { last_received { term: 23 index: 52 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.466150 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 24 FOLLOWER]: Advancing to term 25
I20260319 16:35:43.466732 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 25.
I20260319 16:35:43.467024 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:43.467152 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 FOLLOWER]: Leader election won for term 25
I20260319 16:35:43.467212 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:43.467263 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 23.52, Last appended by leader: 52, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.467681 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 24 to 25, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 25 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:43.525008 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 24. Current term is 25. Ops: []
I20260319 16:35:43.525380 23685 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260319 16:35:43.525521 23685 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 25.53 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 52
I20260319 16:35:43.525570 23688 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 LEADER]: Stepping down as leader of term 24
I20260319 16:35:43.525635 23688 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:43.525691 23688 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 24.53, Last appended by leader: 53, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.525777 23688 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 24 FOLLOWER]: Advancing to term 25
I20260319 16:35:43.559289 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 25 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 24 index: 53. Preceding OpId from leader: term: 25 index: 53. (term mismatch)
I20260319 16:35:43.559374 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 52
I20260319 16:35:43.559393 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 24.53
I20260319 16:35:43.559410 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:43.559670 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260319 16:35:43.560946 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 25 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 23 index: 52. Preceding OpId from leader: term: 25 index: 53. (index mismatch)
I20260319 16:35:43.561126 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260319 16:35:43.662366 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 25 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:43.662489 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 25 FOLLOWER]: Advancing to term 26
I20260319 16:35:43.663198 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.663394 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 26 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:43.663611 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:43.663615 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 26 candidate_status { last_received { term: 25 index: 53 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:43.663759 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 25 FOLLOWER]: Advancing to term 26
I20260319 16:35:43.664462 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 26.
I20260319 16:35:43.664716 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:43.664819 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 FOLLOWER]: Leader election won for term 26
I20260319 16:35:43.664868 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:43.664937 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.665305 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 25. Current term is 26. Ops: []
I20260319 16:35:43.665534 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 25 to 26, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 26 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:43.665627 23689 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 25.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260319 16:35:43.665700 23689 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 26.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260319 16:35:43.665791 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 LEADER]: Stepping down as leader of term 25
I20260319 16:35:43.665827 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:43.665875 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.53, Last appended by leader: 53, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.665948 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 25 FOLLOWER]: Advancing to term 26
I20260319 16:35:43.756495 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 26 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 25 index: 53. Preceding OpId from leader: term: 26 index: 54. (index mismatch)
I20260319 16:35:43.756914 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260319 16:35:43.758111 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 26 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 25 index: 53. Preceding OpId from leader: term: 26 index: 54. (index mismatch)
I20260319 16:35:43.758353 23686 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260319 16:35:43.859807 23688 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:43.859921 23688 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 26 FOLLOWER]: Advancing to term 27
I20260319 16:35:43.860754 23688 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.861052 23688 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 27 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:43.861176 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:43.861188 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.861433 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:43.861524 23688 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260319 16:35:43.875931 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 26. Current term is 27. Ops: []
I20260319 16:35:43.876513 23677 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 26.54, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260319 16:35:43.876650 23677 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 LEADER]: Stepping down as leader of term 26
I20260319 16:35:43.876693 23677 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:43.876755 23677 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.876917 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 26 FOLLOWER]: Advancing to term 27
I20260319 16:35:43.954950 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:43.955245 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 26 FOLLOWER]: Advancing to term 27
I20260319 16:35:43.956192 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.956471 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 27 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:43.956823 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:43.956823 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.957273 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 27: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:43.958348 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 27.
I20260319 16:35:43.958634 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:43.958846 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 FOLLOWER]: Leader election won for term 27
I20260319 16:35:43.958931 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:43.958994 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.959767 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 26 to 27, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 27 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:43.994275 23688 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:43.994410 23688 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 27 FOLLOWER]: Advancing to term 28
I20260319 16:35:43.995229 23688 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.995417 23688 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 28 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:43.995656 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:43.995651 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:43.995779 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 27 FOLLOWER]: Advancing to term 28
I20260319 16:35:43.996402 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 28.
I20260319 16:35:43.996630 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:43.996767 23688 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 FOLLOWER]: Leader election won for term 28
I20260319 16:35:43.996846 23688 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:43.996904 23688 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:43.997354 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 27 to 28, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 28 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:44.058907 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 27. Current term is 28. Ops: []
I20260319 16:35:44.059247 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260319 16:35:44.059363 23676 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 28.55 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 54
I20260319 16:35:44.059397 23689 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 LEADER]: Stepping down as leader of term 27
I20260319 16:35:44.059439 23689 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:44.059501 23689 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.55, Last appended by leader: 55, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.059580 23689 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 27 FOLLOWER]: Advancing to term 28
I20260319 16:35:44.089318 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 28 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 27 index: 55. Preceding OpId from leader: term: 28 index: 55. (term mismatch)
I20260319 16:35:44.089408 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 54
I20260319 16:35:44.089421 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 27.55
I20260319 16:35:44.089434 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:44.089707 23688 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260319 16:35:44.091130 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 28 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260319 16:35:44.091442 23688 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260319 16:35:44.108220 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:44.192711 23677 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 28 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:44.192914 23677 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 28 FOLLOWER]: Advancing to term 29
I20260319 16:35:44.193842 23677 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.194085 23677 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 29 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:44.194242 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 28. Current term is 29. Ops: []
I20260319 16:35:44.194343 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:44.194482 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:44.194533 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 28 FOLLOWER]: Advancing to term 29
I20260319 16:35:44.194973 23690 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 28.55, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260319 16:35:44.195091 23690 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 LEADER]: Stepping down as leader of term 28
I20260319 16:35:44.195119 23690 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:44.195188 23690 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.195273 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 28 FOLLOWER]: Advancing to term 29
I20260319 16:35:44.195309 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 29.
I20260319 16:35:44.195462 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:44.195583 23677 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 FOLLOWER]: Leader election won for term 29
I20260319 16:35:44.195638 23677 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:44.195669 23677 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.196401 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 28 to 29, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 29 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:44.302695 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 29 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 29 index: 56. (index mismatch)
I20260319 16:35:44.303099 23677 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260319 16:35:44.304440 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 29 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 29 index: 56. (index mismatch)
I20260319 16:35:44.304634 23677 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260319 16:35:44.405047 23689 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:44.405153 23689 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 29 FOLLOWER]: Advancing to term 30
I20260319 16:35:44.405911 23689 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.406065 23689 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 30 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:44.406308 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 30 candidate_status { last_received { term: 29 index: 56 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:44.406344 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 30 candidate_status { last_received { term: 29 index: 56 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:44.406455 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 29 FOLLOWER]: Advancing to term 30
I20260319 16:35:44.407109 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 30.
I20260319 16:35:44.407312 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:44.407407 23689 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 FOLLOWER]: Leader election won for term 30
I20260319 16:35:44.407473 23689 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:44.407532 23689 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 29.56, Last appended by leader: 56, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.408160 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 29 to 30, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 30 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:44.416195 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 29. Current term is 30. Ops: []
I20260319 16:35:44.416530 23677 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 29.56, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260319 16:35:44.416644 23677 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 30.57 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 56
I20260319 16:35:44.416692 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 LEADER]: Stepping down as leader of term 29
I20260319 16:35:44.416759 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:44.416826 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 29.56, Last appended by leader: 56, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.417037 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 29 FOLLOWER]: Advancing to term 30
I20260319 16:35:44.505357 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 30 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 29 index: 56. Preceding OpId from leader: term: 30 index: 57. (index mismatch)
I20260319 16:35:44.505715 23689 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260319 16:35:44.506923 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 30 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 29 index: 56. Preceding OpId from leader: term: 30 index: 57. (index mismatch)
I20260319 16:35:44.507181 23689 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260319 16:35:44.608438 23690 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 30 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:44.608544 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 30 FOLLOWER]: Advancing to term 31
I20260319 16:35:44.609293 23690 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.609479 23690 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 31 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:44.609714 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 31 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:44.609726 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 31 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:44.610020 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:44.610160 23690 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260319 16:35:44.621174 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 30. Current term is 31. Ops: []
I20260319 16:35:44.621451 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 30.57, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260319 16:35:44.621583 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 LEADER]: Stepping down as leader of term 30
I20260319 16:35:44.621738 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:44.621932 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 30.57, Last appended by leader: 57, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.622048 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 30 FOLLOWER]: Advancing to term 31
I20260319 16:35:44.683934 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 30 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:44.684121 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 30 FOLLOWER]: Advancing to term 31
I20260319 16:35:44.685012 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.685197 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 31 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:44.685426 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 31 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:44.685427 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 31 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:44.685614 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 31: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:44.686216 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 31.
I20260319 16:35:44.686443 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:44.686601 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 FOLLOWER]: Leader election won for term 31
I20260319 16:35:44.686672 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:44.686721 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 30.57, Last appended by leader: 57, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.687362 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 30 to 31, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 31 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:44.720690 23690 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:44.720811 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 31 FOLLOWER]: Advancing to term 32
I20260319 16:35:44.721577 23690 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.721764 23690 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 32 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:44.721966 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 32 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:44.722054 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 32 candidate_status { last_received { term: 30 index: 57 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:44.722162 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 31 FOLLOWER]: Advancing to term 32
I20260319 16:35:44.722759 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 32.
I20260319 16:35:44.723100 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:44.723237 23690 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 FOLLOWER]: Leader election won for term 32
I20260319 16:35:44.723321 23690 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:44.723380 23690 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 30.57, Last appended by leader: 57, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.724164 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 31 to 32, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 32 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:44.779379 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 32 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 31. Current term is 32. Ops: []
I20260319 16:35:44.779695 23633 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260319 16:35:44.779824 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 LEADER]: Stepping down as leader of term 31
I20260319 16:35:44.779861 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:44.779914 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.58, Last appended by leader: 58, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.779991 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 31 FOLLOWER]: Advancing to term 32
I20260319 16:35:44.801544 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 32 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 30 index: 57. Preceding OpId from leader: term: 32 index: 58. (index mismatch)
I20260319 16:35:44.802062 23690 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260319 16:35:44.803362 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 32 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 31 index: 58. Preceding OpId from leader: term: 32 index: 58. (term mismatch)
I20260319 16:35:44.803486 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 57
I20260319 16:35:44.803507 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 31.58
I20260319 16:35:44.803532 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:44.803735 23690 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260319 16:35:44.904310 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 32 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:44.904424 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 32 FOLLOWER]: Advancing to term 33
I20260319 16:35:44.905112 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.905277 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 33 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:44.905573 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:44.905591 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 33 candidate_status { last_received { term: 32 index: 58 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:44.905676 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 32 FOLLOWER]: Advancing to term 33
I20260319 16:35:44.906488 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 33.
I20260319 16:35:44.906687 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:44.906775 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 FOLLOWER]: Leader election won for term 33
I20260319 16:35:44.906831 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:44.906873 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 32.58, Last appended by leader: 58, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.907421 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 32 to 33, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 33 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:44.910916 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 33 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 32. Current term is 33. Ops: []
I20260319 16:35:44.911187 23690 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 32.58, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260319 16:35:44.911300 23690 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 LEADER]: Stepping down as leader of term 32
I20260319 16:35:44.911327 23690 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:44.911384 23690 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 32.58, Last appended by leader: 58, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:44.911469 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 32 FOLLOWER]: Advancing to term 33
I20260319 16:35:44.996322 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 33 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 32 index: 58. Preceding OpId from leader: term: 33 index: 59. (index mismatch)
I20260319 16:35:44.996627 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260319 16:35:44.997954 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 33 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 32 index: 58. Preceding OpId from leader: term: 33 index: 59. (index mismatch)
I20260319 16:35:44.998286 23691 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260319 16:35:45.108551 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:45.224063 23685 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 33 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:45.224172 23685 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 33 FOLLOWER]: Advancing to term 34
I20260319 16:35:45.224910 23685 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.225095 23685 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 34 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:45.225652 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 34 candidate_status { last_received { term: 33 index: 59 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:45.225708 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 34 candidate_status { last_received { term: 33 index: 59 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:45.225965 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:45.226063 23685 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260319 16:35:45.235687 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 33. Current term is 34. Ops: []
I20260319 16:35:45.236176 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 33.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260319 16:35:45.236390 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 LEADER]: Stepping down as leader of term 33
I20260319 16:35:45.236433 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:45.236497 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 33.59, Last appended by leader: 59, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.236588 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 33 FOLLOWER]: Advancing to term 34
I20260319 16:35:45.256314 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 33 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:45.256435 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 33 FOLLOWER]: Advancing to term 34
I20260319 16:35:45.257185 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.257361 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 34 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:45.257593 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 34 candidate_status { last_received { term: 33 index: 59 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:45.257659 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 34 candidate_status { last_received { term: 33 index: 59 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:45.257663 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 34: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:45.258800 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 34.
I20260319 16:35:45.259090 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:45.259248 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 FOLLOWER]: Leader election won for term 34
I20260319 16:35:45.259331 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:45.259374 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 33.59, Last appended by leader: 59, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.260067 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 33 to 34, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 34 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:45.337205 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 34 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 33 index: 59. Preceding OpId from leader: term: 34 index: 60. (index mismatch)
I20260319 16:35:45.337604 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260319 16:35:45.339030 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 33 index: 59. Preceding OpId from leader: term: 34 index: 60. (index mismatch)
I20260319 16:35:45.339314 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260319 16:35:45.440063 23685 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:45.440196 23685 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 34 FOLLOWER]: Advancing to term 35
I20260319 16:35:45.442502 23685 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.442714 23685 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 35 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:45.443063 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 35 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:45.443097 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 35 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:45.443367 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:45.443461 23685 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260319 16:35:45.461566 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 34. Current term is 35. Ops: []
I20260319 16:35:45.462075 23633 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 34.60, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260319 16:35:45.462199 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 LEADER]: Stepping down as leader of term 34
I20260319 16:35:45.462234 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:45.462337 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 34.60, Last appended by leader: 60, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.462508 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 34 FOLLOWER]: Advancing to term 35
I20260319 16:35:45.520327 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 34 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:45.520447 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 34 FOLLOWER]: Advancing to term 35
I20260319 16:35:45.521345 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.521531 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 35 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:45.521919 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 35 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:45.521944 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 35 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:45.522025 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 35: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:45.522800 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 35.
I20260319 16:35:45.523079 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:45.523288 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 FOLLOWER]: Leader election won for term 35
I20260319 16:35:45.523360 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:45.523422 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 34.60, Last appended by leader: 60, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.524226 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 34 to 35, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 35 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:45.585198 23685 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:45.585314 23685 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 35 FOLLOWER]: Advancing to term 36
I20260319 16:35:45.586112 23685 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.586288 23685 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 36 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:45.586529 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 36 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:45.586593 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 35 FOLLOWER]: Advancing to term 36
I20260319 16:35:45.586688 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 36 candidate_status { last_received { term: 34 index: 60 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:45.587277 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 36.
I20260319 16:35:45.587525 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:45.587683 23685 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 FOLLOWER]: Leader election won for term 36
I20260319 16:35:45.587852 23685 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:45.587900 23685 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 34.60, Last appended by leader: 60, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.588708 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 35 to 36, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 36 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:45.600459 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 36 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 35. Current term is 36. Ops: []
I20260319 16:35:45.600924 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260319 16:35:45.601207 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 LEADER]: Stepping down as leader of term 35
I20260319 16:35:45.601255 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:45.601337 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 35.61, Last appended by leader: 61, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.601428 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 35 FOLLOWER]: Advancing to term 36
I20260319 16:35:45.670616 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 36 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 34 index: 60. Preceding OpId from leader: term: 36 index: 61. (index mismatch)
I20260319 16:35:45.670943 23685 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260319 16:35:45.672482 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 36 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 35 index: 61. Preceding OpId from leader: term: 36 index: 61. (term mismatch)
I20260319 16:35:45.672549 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 60
I20260319 16:35:45.672567 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 35.61
I20260319 16:35:45.672585 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:45.672868 23694 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260319 16:35:45.869386 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 36 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:45.869534 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 36 FOLLOWER]: Advancing to term 37
I20260319 16:35:45.870409 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.870589 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 37 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:45.870924 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 37 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:45.870924 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 37 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:45.871356 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:45.871502 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260319 16:35:45.891144 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 36. Current term is 37. Ops: []
I20260319 16:35:45.891536 23690 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 36.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260319 16:35:45.891783 23690 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 LEADER]: Stepping down as leader of term 36
I20260319 16:35:45.891830 23690 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:45.891896 23690 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 36.61, Last appended by leader: 61, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.891996 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 36 FOLLOWER]: Advancing to term 37
I20260319 16:35:45.948179 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 36 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:45.948340 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 36 FOLLOWER]: Advancing to term 37
I20260319 16:35:45.949458 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.949647 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 37 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:45.950078 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 37 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:45.950106 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 37 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:45.950220 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 37: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:45.950848 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 37 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 37.
I20260319 16:35:45.951242 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 37 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:45.951383 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 FOLLOWER]: Leader election won for term 37
I20260319 16:35:45.951468 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:45.951530 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 36.61, Last appended by leader: 61, Current term: 37, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:45.952324 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 36 to 37, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 37 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:46.017925 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:46.018051 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 37 FOLLOWER]: Advancing to term 38
I20260319 16:35:46.018764 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.018960 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 38 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.019325 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 38 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.019351 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 38 candidate_status { last_received { term: 36 index: 61 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.019402 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 37 FOLLOWER]: Advancing to term 38
I20260319 16:35:46.019999 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 38.
I20260319 16:35:46.020309 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.020465 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 FOLLOWER]: Leader election won for term 38
I20260319 16:35:46.020591 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:46.020648 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 36.61, Last appended by leader: 61, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.021222 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 37 to 38, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 38 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:46.044545 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 38 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 37. Current term is 38. Ops: []
I20260319 16:35:46.044992 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260319 16:35:46.045153 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 LEADER]: Stepping down as leader of term 37
I20260319 16:35:46.045192 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.045255 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 37.62, Last appended by leader: 62, Current term: 37, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.045397 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 37 FOLLOWER]: Advancing to term 38
I20260319 16:35:46.108942 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:46.110836 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 38 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 36 index: 61. Preceding OpId from leader: term: 38 index: 62. (index mismatch)
I20260319 16:35:46.111215 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260319 16:35:46.112588 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 38 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 37 index: 62. Preceding OpId from leader: term: 38 index: 62. (term mismatch)
I20260319 16:35:46.112653 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 61
I20260319 16:35:46.112673 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 37.62
I20260319 16:35:46.112700 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:46.112955 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260319 16:35:46.213222 23690 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 38 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:46.213444 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 38 FOLLOWER]: Advancing to term 39
I20260319 16:35:46.214433 23690 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.214903 23690 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 39 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.214973 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 39 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.215106 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 39 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.215533 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.215691 23690 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260319 16:35:46.223429 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 38. Current term is 39. Ops: []
I20260319 16:35:46.223760 23695 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 38.62, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260319 16:35:46.223922 23633 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 LEADER]: Stepping down as leader of term 38
I20260319 16:35:46.223999 23633 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:46.224076 23633 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 38.62, Last appended by leader: 62, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.224184 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 38 FOLLOWER]: Advancing to term 39
I20260319 16:35:46.301584 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 38 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:46.301736 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 38 FOLLOWER]: Advancing to term 39
I20260319 16:35:46.302541 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.302736 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 39 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:46.303061 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 39 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.303193 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 39 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.303282 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 39: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:46.303882 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 39.
I20260319 16:35:46.304073 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:46.304170 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 FOLLOWER]: Leader election won for term 39
I20260319 16:35:46.304244 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.304322 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 38.62, Last appended by leader: 62, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.304858 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 38 to 39, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 39 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:46.353642 23690 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:46.353770 23690 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 39 FOLLOWER]: Advancing to term 40
I20260319 16:35:46.354739 23690 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.355137 23690 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 40 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.355186 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 40 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.355299 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 40 candidate_status { last_received { term: 38 index: 62 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.355381 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 39 FOLLOWER]: Advancing to term 40
I20260319 16:35:46.356437 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 40.
I20260319 16:35:46.357033 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.357180 23690 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 FOLLOWER]: Leader election won for term 40
I20260319 16:35:46.357308 23690 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:46.357381 23690 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 38.62, Last appended by leader: 62, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.358014 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 39 to 40, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 40 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:46.404862 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 39. Current term is 40. Ops: []
I20260319 16:35:46.405275 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260319 16:35:46.405402 23676 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 40.63 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 62
I20260319 16:35:46.405436 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 LEADER]: Stepping down as leader of term 39
I20260319 16:35:46.405457 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.405514 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 39.63, Last appended by leader: 63, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.405598 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 39 FOLLOWER]: Advancing to term 40
I20260319 16:35:46.451436 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 40 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 38 index: 62. Preceding OpId from leader: term: 40 index: 63. (index mismatch)
I20260319 16:35:46.451781 23694 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260319 16:35:46.452073 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 40 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 39 index: 63. Preceding OpId from leader: term: 40 index: 63. (term mismatch)
I20260319 16:35:46.452129 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 62
I20260319 16:35:46.452147 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 39.63
I20260319 16:35:46.452163 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 40 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:46.452387 23694 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260319 16:35:46.553999 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 40 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:46.554121 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 40 FOLLOWER]: Advancing to term 41
I20260319 16:35:46.554876 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.555045 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 41 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.555022 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 40. Current term is 41. Ops: []
I20260319 16:35:46.555213 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 41 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.555236 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 41 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.555315 23690 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 40.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260319 16:35:46.555404 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:46.555539 23697 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 LEADER]: Stepping down as leader of term 40
I20260319 16:35:46.555563 23633 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20260319 16:35:46.555581 23697 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:46.555681 23697 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 40.63, Last appended by leader: 63, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.555876 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 40 FOLLOWER]: Advancing to term 41
I20260319 16:35:46.635730 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 40 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:46.635845 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 40 FOLLOWER]: Advancing to term 41
I20260319 16:35:46.636534 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.636678 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 41 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:46.636961 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 41 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.636965 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 41 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.637197 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 41: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:46.637647 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 41.
I20260319 16:35:46.637883 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 41 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:46.637995 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 FOLLOWER]: Leader election won for term 41
I20260319 16:35:46.638039 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.638085 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 40.63, Last appended by leader: 63, Current term: 41, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.638665 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 40 to 41, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 41 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:46.677798 23633 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:46.677923 23633 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 41 FOLLOWER]: Advancing to term 42
I20260319 16:35:46.678699 23633 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.678865 23633 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 42 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.679117 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 42 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.679124 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 42 candidate_status { last_received { term: 40 index: 63 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.679221 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 41 FOLLOWER]: Advancing to term 42
I20260319 16:35:46.679765 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 42.
I20260319 16:35:46.680027 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.680128 23633 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 FOLLOWER]: Leader election won for term 42
I20260319 16:35:46.680181 23633 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:46.680228 23633 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 40.63, Last appended by leader: 63, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.680905 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 41 to 42, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 42 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:46.727876 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 41. Current term is 42. Ops: []
I20260319 16:35:46.727878 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 42 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 41. Current term is 42. Ops: []
I20260319 16:35:46.728242 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260319 16:35:46.728475 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 LEADER]: Stepping down as leader of term 41
I20260319 16:35:46.728510 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.728489 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260319 16:35:46.728595 23676 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 42.64 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 63
I20260319 16:35:46.728714 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 41.64, Last appended by leader: 64, Current term: 41, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.728827 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 41 FOLLOWER]: Advancing to term 42
I20260319 16:35:46.771390 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 42 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 40 index: 63. Preceding OpId from leader: term: 42 index: 64. (index mismatch)
I20260319 16:35:46.771759 23633 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260319 16:35:46.772948 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 42 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 41 index: 64. Preceding OpId from leader: term: 42 index: 64. (term mismatch)
I20260319 16:35:46.773012 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 63
I20260319 16:35:46.773032 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 41.64
I20260319 16:35:46.773048 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 42 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:46.773286 23699 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260319 16:35:46.874112 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 42 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:46.874231 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 42 FOLLOWER]: Advancing to term 43
I20260319 16:35:46.875005 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.875178 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 43 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.875440 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 43 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.875440 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 43 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.875738 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 43 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.875892 23697 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Leader election lost for term 43. Reason: could not achieve majority
I20260319 16:35:46.896932 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 42. Current term is 43. Ops: []
I20260319 16:35:46.897291 23695 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 42.64, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260319 16:35:46.897418 23695 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 LEADER]: Stepping down as leader of term 42
I20260319 16:35:46.897449 23695 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:46.897518 23695 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 42.64, Last appended by leader: 64, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.897606 23695 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 42 FOLLOWER]: Advancing to term 43
I20260319 16:35:46.955633 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 42 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:46.955753 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 42 FOLLOWER]: Advancing to term 43
I20260319 16:35:46.956696 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.956897 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 43 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:46.957186 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 43 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:46.957338 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 43: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:46.957187 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 43 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.958145 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 43.
I20260319 16:35:46.958349 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:46.958451 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 FOLLOWER]: Leader election won for term 43
I20260319 16:35:46.958567 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:46.958652 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 42.64, Last appended by leader: 64, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.959339 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 42 to 43, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 43 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:46.978399 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:46.978509 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 43 FOLLOWER]: Advancing to term 44
I20260319 16:35:46.979259 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.979452 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 44 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:46.979677 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 44 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:46.979660 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 44 candidate_status { last_received { term: 42 index: 64 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:46.979770 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 43 FOLLOWER]: Advancing to term 44
I20260319 16:35:46.980520 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 44.
I20260319 16:35:46.980736 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:46.980934 23697 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 FOLLOWER]: Leader election won for term 44
I20260319 16:35:46.980993 23697 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:46.981051 23697 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 42.64, Last appended by leader: 64, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:46.981637 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 43 to 44, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 44 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:47.042778 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 43. Current term is 44. Ops: []
I20260319 16:35:47.043259 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260319 16:35:47.043380 23691 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 44.65 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 64
I20260319 16:35:47.043412 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 LEADER]: Stepping down as leader of term 43
I20260319 16:35:47.043432 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:47.043530 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 43.65, Last appended by leader: 65, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.043602 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 43 FOLLOWER]: Advancing to term 44
I20260319 16:35:47.082051 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 44 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 43 index: 65. Preceding OpId from leader: term: 44 index: 65. (term mismatch)
I20260319 16:35:47.082141 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 64
I20260319 16:35:47.082154 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 43.65
I20260319 16:35:47.082167 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 44 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:47.082433 23697 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260319 16:35:47.083945 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 44 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 42 index: 64. Preceding OpId from leader: term: 44 index: 65. (index mismatch)
I20260319 16:35:47.084250 23700 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260319 16:35:47.109315 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:47.185472 23695 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 44 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:47.185586 23695 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 44 FOLLOWER]: Advancing to term 45
I20260319 16:35:47.186327 23695 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.186517 23695 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 45 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:47.186776 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 45 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:47.186776 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 45 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:47.187199 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 45 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:47.187393 23695 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Leader election lost for term 45. Reason: could not achieve majority
I20260319 16:35:47.207460 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 44. Current term is 45. Ops: []
I20260319 16:35:47.207770 23697 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 44.65, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260319 16:35:47.207878 23697 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 LEADER]: Stepping down as leader of term 44
I20260319 16:35:47.207908 23697 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:47.207965 23697 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 44.65, Last appended by leader: 65, Current term: 44, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.208055 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 44 FOLLOWER]: Advancing to term 45
I20260319 16:35:47.270370 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 44 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:47.270485 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 44 FOLLOWER]: Advancing to term 45
I20260319 16:35:47.271215 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.271363 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 45 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:47.271639 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 45 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:47.271644 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 45 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:47.271764 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 45: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:47.272445 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 45.
I20260319 16:35:47.272701 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:47.272859 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 FOLLOWER]: Leader election won for term 45
I20260319 16:35:47.272918 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:47.272975 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 44.65, Last appended by leader: 65, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.273509 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 44 to 45, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 45 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:47.317193 23695 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:47.317312 23695 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 45 FOLLOWER]: Advancing to term 46
I20260319 16:35:47.318058 23695 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.318239 23695 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 46 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:47.318471 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 46 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:47.318485 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 46 candidate_status { last_received { term: 44 index: 65 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:47.318580 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 45 FOLLOWER]: Advancing to term 46
I20260319 16:35:47.319253 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 46.
I20260319 16:35:47.319442 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:47.319525 23695 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 FOLLOWER]: Leader election won for term 46
I20260319 16:35:47.319578 23695 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:47.319630 23695 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 44.65, Last appended by leader: 65, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.320333 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 45 to 46, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 46 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:47.387791 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 45. Current term is 46. Ops: []
I20260319 16:35:47.388281 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260319 16:35:47.388439 23691 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 46.66 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 65
I20260319 16:35:47.388478 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 LEADER]: Stepping down as leader of term 45
I20260319 16:35:47.388510 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:47.388571 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 45.66, Last appended by leader: 66, Current term: 45, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.388656 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 45 FOLLOWER]: Advancing to term 46
I20260319 16:35:47.427784 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 46 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 45 index: 66. Preceding OpId from leader: term: 46 index: 66. (term mismatch)
I20260319 16:35:47.427927 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 65
I20260319 16:35:47.427940 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 45.66
I20260319 16:35:47.427954 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 46 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:47.428234 23695 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260319 16:35:47.429373 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 46 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 44 index: 65. Preceding OpId from leader: term: 46 index: 66. (index mismatch)
I20260319 16:35:47.429580 23699 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260319 16:35:47.778431 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 46 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:47.778548 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 46 FOLLOWER]: Advancing to term 47
I20260319 16:35:47.779287 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.779455 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 47 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:47.779678 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 47 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:47.779680 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 47 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:47.779978 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 47 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:47.780118 23697 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Leader election lost for term 47. Reason: could not achieve majority
I20260319 16:35:47.791823 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 46. Current term is 47. Ops: []
I20260319 16:35:47.792292 23695 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 46.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260319 16:35:47.792439 23699 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 LEADER]: Stepping down as leader of term 46
I20260319 16:35:47.792511 23699 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:47.792582 23699 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 46.66, Last appended by leader: 66, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.792681 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 46 FOLLOWER]: Advancing to term 47
I20260319 16:35:47.834245 23691 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 46 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:47.834370 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 46 FOLLOWER]: Advancing to term 47
I20260319 16:35:47.835287 23691 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.835479 23691 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 47 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:47.835767 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 47 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:47.835861 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 47: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:47.835774 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 47 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:47.836812 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 47.
I20260319 16:35:47.837121 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:47.837327 23691 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 FOLLOWER]: Leader election won for term 47
I20260319 16:35:47.837405 23691 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:47.837446 23691 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 46.66, Last appended by leader: 66, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.838177 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 46 to 47, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 47 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:47.909829 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:47.909955 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 47 FOLLOWER]: Advancing to term 48
I20260319 16:35:47.910737 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.910921 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 48 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:47.911260 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 48 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:47.911262 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 48 candidate_status { last_received { term: 46 index: 66 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:47.911396 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 47 FOLLOWER]: Advancing to term 48
I20260319 16:35:47.912248 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 48.
I20260319 16:35:47.912593 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:47.912725 23697 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 FOLLOWER]: Leader election won for term 48
I20260319 16:35:47.913153 23697 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:47.913221 23697 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 46.66, Last appended by leader: 66, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.913848 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 47 to 48, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 48 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:47.941720 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 48 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 47. Current term is 48. Ops: []
I20260319 16:35:47.942078 23691 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260319 16:35:47.942206 23691 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 LEADER]: Stepping down as leader of term 47
I20260319 16:35:47.942233 23691 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:47.942288 23691 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 47.67, Last appended by leader: 67, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:47.942358 23691 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 47 FOLLOWER]: Advancing to term 48
I20260319 16:35:48.009478 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 48 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 47 index: 67. Preceding OpId from leader: term: 48 index: 67. (term mismatch)
I20260319 16:35:48.009557 23503 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 66
I20260319 16:35:48.009575 23503 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 47.67
I20260319 16:35:48.009591 23503 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 48 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:48.009824 23697 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260319 16:35:48.011106 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 48 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 46 index: 66. Preceding OpId from leader: term: 48 index: 67. (index mismatch)
I20260319 16:35:48.011390 23697 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260319 16:35:48.109627 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:48.113013 23695 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 48 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:48.113142 23695 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 48 FOLLOWER]: Advancing to term 49
I20260319 16:35:48.113942 23695 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.114128 23695 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 49 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:48.114360 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 49 candidate_status { last_received { term: 48 index: 67 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:48.114360 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 49 candidate_status { last_received { term: 48 index: 67 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:48.114470 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 48 FOLLOWER]: Advancing to term 49
I20260319 16:35:48.115047 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 49 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 49.
I20260319 16:35:48.115237 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 49 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:48.115335 23695 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 FOLLOWER]: Leader election won for term 49
I20260319 16:35:48.115388 23695 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:48.115438 23695 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 48.67, Last appended by leader: 67, Current term: 49, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.115967 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 48 to 49, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 49 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:48.131217 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 49 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 48. Current term is 49. Ops: []
I20260319 16:35:48.131606 23697 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 48.67, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260319 16:35:48.131726 23697 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 LEADER]: Stepping down as leader of term 48
I20260319 16:35:48.131748 23697 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:48.131801 23697 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 48.67, Last appended by leader: 67, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.131877 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 48 FOLLOWER]: Advancing to term 49
I20260319 16:35:48.199880 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 49 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 48 index: 67. Preceding OpId from leader: term: 49 index: 68. (index mismatch)
I20260319 16:35:48.200384 23695 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260319 16:35:48.201876 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 49 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 48 index: 67. Preceding OpId from leader: term: 49 index: 68. (index mismatch)
I20260319 16:35:48.202168 23695 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260319 16:35:48.302685 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 49 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:48.302804 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 49 FOLLOWER]: Advancing to term 50
I20260319 16:35:48.303489 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.303653 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 50 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:48.303901 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 50 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:48.303901 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 50 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:48.304212 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 50 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:48.304365 23676 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Leader election lost for term 50. Reason: could not achieve majority
I20260319 16:35:48.321146 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 49. Current term is 50. Ops: []
I20260319 16:35:48.321504 23705 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 49.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260319 16:35:48.321635 23705 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 LEADER]: Stepping down as leader of term 49
I20260319 16:35:48.321653 23705 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:48.321707 23705 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 49.68, Last appended by leader: 68, Current term: 49, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.321869 23705 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 49 FOLLOWER]: Advancing to term 50
I20260319 16:35:48.390782 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 49 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:48.390903 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 49 FOLLOWER]: Advancing to term 50
I20260319 16:35:48.392019 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.392233 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 50 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:48.392498 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 50 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:48.392578 23503 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 50: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:48.392504 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 50 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:48.393253 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 50.
I20260319 16:35:48.393527 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:48.393651 23697 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 FOLLOWER]: Leader election won for term 50
I20260319 16:35:48.393697 23697 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:48.393733 23697 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 49.68, Last appended by leader: 68, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.394476 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 49 to 50, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 50 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:48.439882 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:48.440080 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 50 FOLLOWER]: Advancing to term 51
I20260319 16:35:48.440976 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.441161 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 51 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:48.441463 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 51 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:48.441463 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 51 candidate_status { last_received { term: 49 index: 68 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:48.441583 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 50 FOLLOWER]: Advancing to term 51
I20260319 16:35:48.442353 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 51.
I20260319 16:35:48.442584 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:48.442691 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 FOLLOWER]: Leader election won for term 51
I20260319 16:35:48.442746 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:48.442798 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 49.68, Last appended by leader: 68, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.443562 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 50 to 51, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 51 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:48.511865 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 51 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 50. Current term is 51. Ops: []
I20260319 16:35:48.512382 23697 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260319 16:35:48.512517 23697 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 LEADER]: Stepping down as leader of term 50
I20260319 16:35:48.512552 23697 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:48.512670 23697 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 50.69, Last appended by leader: 69, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.512809 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 50 FOLLOWER]: Advancing to term 51
I20260319 16:35:48.534076 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 51 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 49 index: 68. Preceding OpId from leader: term: 51 index: 69. (index mismatch)
I20260319 16:35:48.534476 23691 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260319 16:35:48.534816 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 51 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 50 index: 69. Preceding OpId from leader: term: 51 index: 69. (term mismatch)
I20260319 16:35:48.534880 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 68
I20260319 16:35:48.534897 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 50.69
I20260319 16:35:48.534915 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 51 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:48.535132 23691 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260319 16:35:48.635672 23705 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 51 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:48.635773 23705 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 51 FOLLOWER]: Advancing to term 52
I20260319 16:35:48.636618 23705 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.636819 23705 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 52 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:48.636931 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 51. Current term is 52. Ops: []
I20260319 16:35:48.636999 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 52 candidate_status { last_received { term: 51 index: 69 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:48.637066 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 51 FOLLOWER]: Advancing to term 52
I20260319 16:35:48.637147 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 52 candidate_status { last_received { term: 51 index: 69 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:48.637548 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 51.69, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260319 16:35:48.637693 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 LEADER]: Stepping down as leader of term 51
I20260319 16:35:48.637732 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:48.637789 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 51.69, Last appended by leader: 69, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.637874 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 51 FOLLOWER]: Advancing to term 52
I20260319 16:35:48.637997 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 52.
I20260319 16:35:48.638217 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:48.638352 23705 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 FOLLOWER]: Leader election won for term 52
I20260319 16:35:48.638428 23705 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:48.638487 23705 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 51.69, Last appended by leader: 69, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.639192 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 51 to 52, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 52 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:48.722112 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 52 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 51 index: 69. Preceding OpId from leader: term: 52 index: 70. (index mismatch)
I20260319 16:35:48.722561 23705 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260319 16:35:48.724304 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 52 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 51 index: 69. Preceding OpId from leader: term: 52 index: 70. (index mismatch)
I20260319 16:35:48.724576 23695 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260319 16:35:48.901747 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 52 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:48.901882 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 52 FOLLOWER]: Advancing to term 53
I20260319 16:35:48.902613 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.902794 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 53 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:48.903237 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 53 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:48.903246 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 53 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:48.903556 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 53 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:48.903697 23676 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Leader election lost for term 53. Reason: could not achieve majority
I20260319 16:35:48.908437 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 52. Current term is 53. Ops: []
I20260319 16:35:48.908885 23699 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 52.70, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260319 16:35:48.909057 23699 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 LEADER]: Stepping down as leader of term 52
I20260319 16:35:48.909176 23699 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:48.909276 23699 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 52.70, Last appended by leader: 70, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.909368 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 52 FOLLOWER]: Advancing to term 53
I20260319 16:35:48.919829 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 52 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:48.919934 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 52 FOLLOWER]: Advancing to term 53
I20260319 16:35:48.921186 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.921451 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 53 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:48.921672 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 53 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:48.921739 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 53 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:48.921742 23503 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 53: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:48.922534 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 53.
I20260319 16:35:48.922856 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:48.923157 23697 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 FOLLOWER]: Leader election won for term 53
I20260319 16:35:48.923230 23697 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:48.923406 23697 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 52.70, Last appended by leader: 70, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:48.924463 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 52 to 53, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 53 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:49.009686 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:49.009889 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 53 FOLLOWER]: Advancing to term 54
I20260319 16:35:49.010540 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.010699 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 54 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:49.010936 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 54 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:49.010967 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 54 candidate_status { last_received { term: 52 index: 70 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:49.010998 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 53 FOLLOWER]: Advancing to term 54
I20260319 16:35:49.011883 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 54.
I20260319 16:35:49.012104 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:49.012342 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 FOLLOWER]: Leader election won for term 54
I20260319 16:35:49.012415 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:49.012466 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 52.70, Last appended by leader: 70, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.012913 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 53. Current term is 54. Ops: []
I20260319 16:35:49.013104 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 53 to 54, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 54 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:49.013278 23697 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260319 16:35:49.013496 23697 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 54.71 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 70
I20260319 16:35:49.013582 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 LEADER]: Stepping down as leader of term 53
I20260319 16:35:49.013649 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:49.013727 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 53.71, Last appended by leader: 71, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.014014 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 53 FOLLOWER]: Advancing to term 54
I20260319 16:35:49.097786 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 54 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 52 index: 70. Preceding OpId from leader: term: 54 index: 71. (index mismatch)
I20260319 16:35:49.098271 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260319 16:35:49.099689 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 54 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 53 index: 71. Preceding OpId from leader: term: 54 index: 71. (term mismatch)
I20260319 16:35:49.099761 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 70
I20260319 16:35:49.099781 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 53.71
I20260319 16:35:49.099798 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 54 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:49.100082 23706 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260319 16:35:49.109948 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:49.282807 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 54 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:49.282951 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 54 FOLLOWER]: Advancing to term 55
I20260319 16:35:49.283761 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.283969 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 55 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:49.284192 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 55 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:49.284204 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 55 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:49.284495 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:49.284655 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260319 16:35:49.287813 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 54 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:49.287916 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 54 FOLLOWER]: Advancing to term 55
I20260319 16:35:49.288735 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.288921 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 55 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:49.289179 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 55 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:49.289212 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 55 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:49.289289 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 55: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:49.289463 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:49.289587 23697 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260319 16:35:49.290452 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 55 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 54. Current term is 55. Ops: []
I20260319 16:35:49.290751 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 54.71, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260319 16:35:49.290942 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 LEADER]: Stepping down as leader of term 54
I20260319 16:35:49.290979 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:49.291023 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 54.71, Last appended by leader: 71, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.291100 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 54 FOLLOWER]: Advancing to term 55
I20260319 16:35:49.291165 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 55 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 54. Current term is 55. Ops: []
I20260319 16:35:49.390283 23697 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 55 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:49.390407 23697 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 55 FOLLOWER]: Advancing to term 56
I20260319 16:35:49.391182 23697 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.391351 23697 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 56 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:49.391595 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 56 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:49.391664 23503 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 55 FOLLOWER]: Advancing to term 56
I20260319 16:35:49.391608 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 56 candidate_status { last_received { term: 54 index: 71 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:49.391708 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 55 FOLLOWER]: Advancing to term 56
I20260319 16:35:49.392238 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 56.
I20260319 16:35:49.392463 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:49.392607 23697 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 FOLLOWER]: Leader election won for term 56
I20260319 16:35:49.392642 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 56.
I20260319 16:35:49.392678 23697 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:49.392742 23697 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 54.71, Last appended by leader: 71, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.393435 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 54 to 56, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 56 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:49.479960 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 56 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 54 index: 71. Preceding OpId from leader: term: 56 index: 72. (index mismatch)
I20260319 16:35:49.480405 23697 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260319 16:35:49.482003 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 56 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 54 index: 71. Preceding OpId from leader: term: 56 index: 72. (index mismatch)
I20260319 16:35:49.482340 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260319 16:35:49.583525 23706 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 56 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:49.583667 23706 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 56 FOLLOWER]: Advancing to term 57
I20260319 16:35:49.584568 23706 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.584740 23706 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 57 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:49.585067 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 57 candidate_status { last_received { term: 56 index: 72 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:49.585098 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 57 candidate_status { last_received { term: 56 index: 72 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:49.585172 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 56 FOLLOWER]: Advancing to term 57
I20260319 16:35:49.585341 23503 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 56. Current term is 57. Ops: []
I20260319 16:35:49.585589 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 56.72, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260319 16:35:49.585875 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 LEADER]: Stepping down as leader of term 56
I20260319 16:35:49.585918 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:49.585986 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 56.72, Last appended by leader: 72, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.586079 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 57 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 57.
I20260319 16:35:49.586086 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 56 FOLLOWER]: Advancing to term 57
I20260319 16:35:49.586297 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 57 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:49.586410 23706 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 FOLLOWER]: Leader election won for term 57
I20260319 16:35:49.586519 23706 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:49.586593 23706 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 56.72, Last appended by leader: 72, Current term: 57, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.587538 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 56 to 57, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 57 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:49.690112 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 57 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 56 index: 72. Preceding OpId from leader: term: 57 index: 73. (index mismatch)
I20260319 16:35:49.690529 23706 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260319 16:35:49.691946 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 57 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 56 index: 72. Preceding OpId from leader: term: 57 index: 73. (index mismatch)
I20260319 16:35:49.692128 23707 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260319 16:35:49.967847 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 57 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:49.967967 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 57 FOLLOWER]: Advancing to term 58
I20260319 16:35:49.968786 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.968971 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 58 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:49.969234 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 58 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:49.969241 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 58 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:49.969610 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 58 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:49.969707 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Leader election lost for term 58. Reason: could not achieve majority
I20260319 16:35:49.972478 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 57. Current term is 58. Ops: []
I20260319 16:35:49.972893 23707 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 57.73, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260319 16:35:49.973069 23707 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 LEADER]: Stepping down as leader of term 57
I20260319 16:35:49.973094 23707 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:49.973155 23707 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 57.73, Last appended by leader: 73, Current term: 57, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.973250 23707 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 57 FOLLOWER]: Advancing to term 58
I20260319 16:35:49.991168 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 57 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:49.991375 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 57 FOLLOWER]: Advancing to term 58
I20260319 16:35:49.992141 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.992369 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 58 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:49.992646 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 58 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:49.992801 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 58: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:49.992646 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 58 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:49.993966 23503 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 58.
I20260319 16:35:49.994300 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:49.994436 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 FOLLOWER]: Leader election won for term 58
I20260319 16:35:49.994606 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:49.994650 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 57.73, Last appended by leader: 73, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:49.995736 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 57 to 58, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 58 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:50.110399 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:50.110649 23503 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 58 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 57 index: 73. Preceding OpId from leader: term: 58 index: 74. (index mismatch)
I20260319 16:35:50.111217 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260319 16:35:50.111481 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:50.111562 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 58 FOLLOWER]: Advancing to term 59
I20260319 16:35:50.112746 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.112982 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 58. Current term is 59. Ops: []
I20260319 16:35:50.113159 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 59 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.113178 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 59 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.113202 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 59 candidate_status { last_received { term: 57 index: 73 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.113371 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 59 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:50.113211 23708 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260319 16:35:50.113483 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Leader election lost for term 59. Reason: could not achieve majority
I20260319 16:35:50.113526 23708 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 LEADER]: Stepping down as leader of term 58
I20260319 16:35:50.113556 23708 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:50.113606 23708 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 58.74, Last appended by leader: 74, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.113682 23708 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 58 FOLLOWER]: Advancing to term 59
I20260319 16:35:50.213259 23707 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 58 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:50.213433 23707 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 58 FOLLOWER]: Advancing to term 59
I20260319 16:35:50.214470 23707 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.214877 23707 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 59 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:50.215072 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 59 candidate_status { last_received { term: 58 index: 74 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.215076 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 59 candidate_status { last_received { term: 58 index: 74 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:50.215277 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 59: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:50.215840 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 59.
I20260319 16:35:50.216090 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:50.216208 23707 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 FOLLOWER]: Leader election won for term 59
I20260319 16:35:50.216416 23707 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:50.216488 23707 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 58.74, Last appended by leader: 74, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.217242 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 58 to 59, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 59 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:50.292375 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 57 index: 73. Preceding OpId from leader: term: 59 index: 75. (index mismatch)
I20260319 16:35:50.292378 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 59 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 58 index: 74. Preceding OpId from leader: term: 59 index: 75. (index mismatch)
I20260319 16:35:50.292661 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 73, Time since last communication: 0.000s
I20260319 16:35:50.292901 23707 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260319 16:35:50.394351 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:50.394497 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 59 FOLLOWER]: Advancing to term 60
I20260319 16:35:50.394546 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 59 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:50.394640 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 59 FOLLOWER]: Advancing to term 60
I20260319 16:35:50.395298 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.395344 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.395478 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 60 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.395678 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 60 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.395691 23503 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 60 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.395691 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 60 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.395678 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 60 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:50.395833 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 60: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:50.395869 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 60: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:50.395840 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 60 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.396070 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:50.396111 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:50.396190 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260319 16:35:50.396226 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260319 16:35:50.396652 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 60 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 59. Current term is 60. Ops: []
I20260319 16:35:50.396941 23676 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 59.75, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260319 16:35:50.397068 23676 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 LEADER]: Stepping down as leader of term 59
I20260319 16:35:50.397151 23676 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:50.397198 23676 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 59.75, Last appended by leader: 75, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.397267 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 59 FOLLOWER]: Advancing to term 60
I20260319 16:35:50.530788 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:50.530900 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 60 FOLLOWER]: Advancing to term 61
I20260319 16:35:50.533201 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.533540 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 61 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.533660 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 61 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:50.533728 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 60 FOLLOWER]: Advancing to term 61
I20260319 16:35:50.533818 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 61 candidate_status { last_received { term: 59 index: 75 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.533905 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 60 FOLLOWER]: Advancing to term 61
I20260319 16:35:50.534495 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 61.
I20260319 16:35:50.534739 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:50.534834 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 FOLLOWER]: Leader election won for term 61
I20260319 16:35:50.534888 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:50.534999 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 59.75, Last appended by leader: 75, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.535108 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 61.
I20260319 16:35:50.535769 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 59 to 61, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 61 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:50.616904 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 61 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 59 index: 75. Preceding OpId from leader: term: 61 index: 76. (index mismatch)
I20260319 16:35:50.617389 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260319 16:35:50.619062 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 61 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 59 index: 75. Preceding OpId from leader: term: 61 index: 76. (index mismatch)
I20260319 16:35:50.619338 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260319 16:35:50.720780 23676 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 61 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:50.720908 23676 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 61 FOLLOWER]: Advancing to term 62
I20260319 16:35:50.722051 23676 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.722326 23676 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 62 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:50.722769 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 62 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.722970 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 62 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:50.723088 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 61 FOLLOWER]: Advancing to term 62
I20260319 16:35:50.724010 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 62 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 62.
I20260319 16:35:50.724246 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 62 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:50.724457 23676 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 FOLLOWER]: Leader election won for term 62
I20260319 16:35:50.724522 23676 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:50.724571 23676 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 61.76, Last appended by leader: 76, Current term: 62, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.725504 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 61 to 62, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 62 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:50.726203 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 61. Current term is 62. Ops: []
I20260319 16:35:50.726537 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 61.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260319 16:35:50.726629 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 62.77 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 76
I20260319 16:35:50.726661 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 LEADER]: Stepping down as leader of term 61
I20260319 16:35:50.726687 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:50.726749 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 61.76, Last appended by leader: 76, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.726833 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 61 FOLLOWER]: Advancing to term 62
I20260319 16:35:50.832904 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 62 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 61 index: 76. Preceding OpId from leader: term: 62 index: 77. (index mismatch)
I20260319 16:35:50.833408 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260319 16:35:50.835256 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 62 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 61 index: 76. Preceding OpId from leader: term: 62 index: 77. (index mismatch)
I20260319 16:35:50.835378 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:50.835440 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 62 FOLLOWER]: Advancing to term 63
I20260319 16:35:50.835661 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260319 16:35:50.837179 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.837342 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 62. Current term is 63. Ops: [62.77-62.77]
I20260319 16:35:50.837527 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 63 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.837528 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 63 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.837435 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 63 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.837883 23709 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 61.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.001s
I20260319 16:35:50.838513 23709 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 LEADER]: Stepping down as leader of term 62
I20260319 16:35:50.838548 23709 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:50.838606 23709 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 62.77, Last appended by leader: 77, Current term: 62, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.837951 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 63 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:50.838953 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Leader election lost for term 63. Reason: could not achieve majority
I20260319 16:35:50.839385 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 62 FOLLOWER]: Advancing to term 63
I20260319 16:35:50.952426 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 62 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:50.952529 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 62 FOLLOWER]: Advancing to term 63
I20260319 16:35:50.953305 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.953504 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 63 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.953739 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 63 candidate_status { last_received { term: 62 index: 77 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.953837 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 63 candidate_status { last_received { term: 62 index: 77 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:50.953920 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 63: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:50.954490 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 63.
I20260319 16:35:50.954820 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:50.955008 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 FOLLOWER]: Leader election won for term 63
I20260319 16:35:50.955054 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:50.955096 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 62.77, Last appended by leader: 77, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.955940 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 62 to 63, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 63 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:50.980388 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:50.980506 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 63 FOLLOWER]: Advancing to term 64
I20260319 16:35:50.981302 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:50.981478 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 64 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:50.981742 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 64 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:50.981840 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 63 FOLLOWER]: Advancing to term 64
I20260319 16:35:50.981812 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 64 candidate_status { last_received { term: 61 index: 76 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:50.982697 23502 raft_consensus.cc:2410] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 for term 64 because replica has last-logged OpId of term: 62 index: 77, which is greater than that of the candidate, which has last-logged OpId of term: 61 index: 76.
I20260319 16:35:50.983135 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:50.983278 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20260319 16:35:51.043216 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 64 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 63. Current term is 64. Ops: []
I20260319 16:35:51.043658 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260319 16:35:51.043889 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 LEADER]: Stepping down as leader of term 63
I20260319 16:35:51.043922 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:51.043977 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 63.78, Last appended by leader: 78, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.044085 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 63 FOLLOWER]: Advancing to term 64
I20260319 16:35:51.065361 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 64 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:51.065466 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 64 FOLLOWER]: Advancing to term 65
I20260319 16:35:51.066217 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.066452 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 65 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:51.066659 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 65 candidate_status { last_received { term: 62 index: 77 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:51.066659 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 65 candidate_status { last_received { term: 62 index: 77 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:51.066754 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 64 FOLLOWER]: Advancing to term 65
I20260319 16:35:51.066781 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 64 FOLLOWER]: Advancing to term 65
I20260319 16:35:51.067415 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 65.
I20260319 16:35:51.067528 23579 raft_consensus.cc:2410] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 65 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 for term 65 because replica has last-logged OpId of term: 63 index: 78, which is greater than that of the candidate, which has last-logged OpId of term: 62 index: 77.
I20260319 16:35:51.067726 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 65 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters:
I20260319 16:35:51.067834 23709 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 FOLLOWER]: Leader election won for term 65
I20260319 16:35:51.067888 23709 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:51.067924 23709 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 62.77, Last appended by leader: 77, Current term: 65, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.068812 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 63 to 65, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 65 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:51.110723 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:51.152137 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 65 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 63 index: 78. Preceding OpId from leader: term: 65 index: 78. (term mismatch)
I20260319 16:35:51.152221 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 77
I20260319 16:35:51.152235 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 63.78
I20260319 16:35:51.152248 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 65 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:51.152684 23709 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260319 16:35:51.154630 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 65 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 61 index: 76. Preceding OpId from leader: term: 65 index: 78. (index mismatch)
I20260319 16:35:51.155275 23676 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 76, Time since last communication: 0.000s
I20260319 16:35:51.366747 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 65 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:51.366868 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 65 FOLLOWER]: Advancing to term 66
I20260319 16:35:51.367631 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.367801 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 66 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:51.368042 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 66 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:51.368106 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 66 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:51.368296 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 66 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:51.368412 23699 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Leader election lost for term 66. Reason: could not achieve majority
I20260319 16:35:51.384899 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 65. Current term is 66. Ops: []
I20260319 16:35:51.385305 23712 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 65.78, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260319 16:35:51.385460 23712 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 LEADER]: Stepping down as leader of term 65
I20260319 16:35:51.385499 23712 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:51.385558 23712 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 65.78, Last appended by leader: 78, Current term: 65, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.385635 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 65 FOLLOWER]: Advancing to term 66
I20260319 16:35:51.441192 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 65 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:51.441305 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 65 FOLLOWER]: Advancing to term 66
I20260319 16:35:51.442121 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.442303 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 66 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:51.442523 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 66 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:51.442720 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 66 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:51.442881 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 66: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:51.443351 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 66.
I20260319 16:35:51.443622 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 66 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:51.443856 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 FOLLOWER]: Leader election won for term 66
I20260319 16:35:51.443931 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:51.443986 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 65.78, Last appended by leader: 78, Current term: 66, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.444737 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 65 to 66, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 66 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:51.473371 23699 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:51.473486 23699 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 66 FOLLOWER]: Advancing to term 67
I20260319 16:35:51.474269 23699 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.474440 23699 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 67 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:51.474748 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 67 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:51.474836 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 67 candidate_status { last_received { term: 65 index: 78 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:51.474841 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 66 FOLLOWER]: Advancing to term 67
I20260319 16:35:51.475539 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 67.
I20260319 16:35:51.475781 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:51.475898 23699 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 FOLLOWER]: Leader election won for term 67
I20260319 16:35:51.475965 23699 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:51.476014 23699 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 65.78, Last appended by leader: 78, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.476625 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 66 to 67, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 67 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:51.523065 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 66. Current term is 67. Ops: []
I20260319 16:35:51.523394 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260319 16:35:51.523507 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 67.79 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 78
I20260319 16:35:51.523540 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 LEADER]: Stepping down as leader of term 66
I20260319 16:35:51.523566 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:51.523627 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 66.79, Last appended by leader: 79, Current term: 66, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.523699 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 66 FOLLOWER]: Advancing to term 67
I20260319 16:35:51.572479 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 67 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 65 index: 78. Preceding OpId from leader: term: 67 index: 79. (index mismatch)
I20260319 16:35:51.572932 23699 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260319 16:35:51.574020 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 67 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 66 index: 79. Preceding OpId from leader: term: 67 index: 79. (term mismatch)
I20260319 16:35:51.574077 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 78
I20260319 16:35:51.574095 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 66.79
I20260319 16:35:51.574111 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 67 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:51.574326 23711 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260319 16:35:51.674746 23712 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 67 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:51.674870 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 67 FOLLOWER]: Advancing to term 68
I20260319 16:35:51.675587 23712 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.675740 23712 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 68 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:51.676028 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 68 candidate_status { last_received { term: 67 index: 79 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:51.676066 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 68 candidate_status { last_received { term: 67 index: 79 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:51.676127 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 67 FOLLOWER]: Advancing to term 68
I20260319 16:35:51.676754 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 68 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 68.
I20260319 16:35:51.676972 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 68 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:51.677073 23712 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 FOLLOWER]: Leader election won for term 68
I20260319 16:35:51.677124 23712 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:51.677181 23712 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 67.79, Last appended by leader: 79, Current term: 68, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.677839 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 67 to 68, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 68 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:51.686718 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 68 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 67. Current term is 68. Ops: []
I20260319 16:35:51.687098 23713 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 67.79, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260319 16:35:51.687229 23713 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 LEADER]: Stepping down as leader of term 67
I20260319 16:35:51.687258 23713 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:51.687316 23713 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 67.79, Last appended by leader: 79, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.687389 23713 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 67 FOLLOWER]: Advancing to term 68
I20260319 16:35:51.687430 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 67. Current term is 68. Ops: []
I20260319 16:35:51.780807 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 68 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 67 index: 79. Preceding OpId from leader: term: 68 index: 80. (index mismatch)
I20260319 16:35:51.781178 23712 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260319 16:35:51.782336 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 68 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 67 index: 79. Preceding OpId from leader: term: 68 index: 80. (index mismatch)
I20260319 16:35:51.782531 23712 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260319 16:35:51.883153 23710 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 68 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:51.883272 23710 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 68 FOLLOWER]: Advancing to term 69
I20260319 16:35:51.884043 23710 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.884233 23710 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 69 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:51.884438 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 69 candidate_status { last_received { term: 68 index: 80 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:51.884442 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 69 candidate_status { last_received { term: 68 index: 80 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:51.884552 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 68 FOLLOWER]: Advancing to term 69
I20260319 16:35:51.885202 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 69.
I20260319 16:35:51.885442 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:51.885576 23710 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 FOLLOWER]: Leader election won for term 69
I20260319 16:35:51.885648 23710 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:51.885908 23710 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 68.80, Last appended by leader: 80, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.886492 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 68 to 69, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 69 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:51.895089 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 69 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 68. Current term is 69. Ops: []
I20260319 16:35:51.895435 23712 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 68.80, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260319 16:35:51.895758 23709 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 LEADER]: Stepping down as leader of term 68
I20260319 16:35:51.895874 23709 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:51.895944 23709 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 68.80, Last appended by leader: 80, Current term: 68, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:51.896044 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 68 FOLLOWER]: Advancing to term 69
I20260319 16:35:51.971556 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 69 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 68 index: 80. Preceding OpId from leader: term: 69 index: 81. (index mismatch)
I20260319 16:35:51.972013 23710 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260319 16:35:51.973423 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 69 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 68 index: 80. Preceding OpId from leader: term: 69 index: 81. (index mismatch)
I20260319 16:35:51.973682 23710 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260319 16:35:52.111037 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:52.163102 23713 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 69 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:52.163249 23713 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 69 FOLLOWER]: Advancing to term 70
I20260319 16:35:52.164048 23713 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.164218 23713 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 70 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:52.164471 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 70 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:52.164485 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 70 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:52.164680 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 70 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:52.164891 23713 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Leader election lost for term 70. Reason: could not achieve majority
I20260319 16:35:52.184726 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 69. Current term is 70. Ops: []
I20260319 16:35:52.185081 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 69.81, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260319 16:35:52.185212 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 LEADER]: Stepping down as leader of term 69
I20260319 16:35:52.185246 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:52.185307 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 69.81, Last appended by leader: 81, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.185384 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 69 FOLLOWER]: Advancing to term 70
I20260319 16:35:52.269266 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 69 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:52.269376 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 69 FOLLOWER]: Advancing to term 70
I20260319 16:35:52.270123 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.270289 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 70 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:52.270538 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 70 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:52.270543 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 70 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:52.270680 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 70: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:52.271507 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 70 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 70.
I20260319 16:35:52.271713 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 70 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:52.271849 23709 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 FOLLOWER]: Leader election won for term 70
I20260319 16:35:52.271903 23709 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:52.271945 23709 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 69.81, Last appended by leader: 81, Current term: 70, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.272650 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 69 to 70, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 70 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:52.286509 23713 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:52.286624 23713 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 70 FOLLOWER]: Advancing to term 71
I20260319 16:35:52.287411 23713 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.287767 23713 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 71 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:52.287992 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 71 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:52.287992 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 71 candidate_status { last_received { term: 69 index: 81 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:52.288100 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 70 FOLLOWER]: Advancing to term 71
I20260319 16:35:52.288802 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 71.
I20260319 16:35:52.289096 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:52.289196 23713 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 FOLLOWER]: Leader election won for term 71
I20260319 16:35:52.289310 23713 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:52.289384 23713 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 69.81, Last appended by leader: 81, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.290418 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 70 to 71, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 71 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:52.355595 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 71 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 70. Current term is 71. Ops: []
I20260319 16:35:52.356020 23709 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260319 16:35:52.356144 23709 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 LEADER]: Stepping down as leader of term 70
I20260319 16:35:52.356328 23709 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:52.356387 23709 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 70.82, Last appended by leader: 82, Current term: 70, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.356473 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 70 FOLLOWER]: Advancing to term 71
I20260319 16:35:52.370445 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 71 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 69 index: 81. Preceding OpId from leader: term: 71 index: 82. (index mismatch)
I20260319 16:35:52.370815 23713 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260319 16:35:52.371847 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 71 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 70 index: 82. Preceding OpId from leader: term: 71 index: 82. (term mismatch)
I20260319 16:35:52.371905 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 81
I20260319 16:35:52.371924 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 70.82
I20260319 16:35:52.371945 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 71 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:52.372219 23713 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260319 16:35:52.472841 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 71 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:52.472965 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 71 FOLLOWER]: Advancing to term 72
I20260319 16:35:52.473664 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.474048 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 72 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:52.474102 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 72 candidate_status { last_received { term: 71 index: 82 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:52.474117 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 72 candidate_status { last_received { term: 71 index: 82 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:52.474226 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 71 FOLLOWER]: Advancing to term 72
I20260319 16:35:52.474809 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 72 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 72.
I20260319 16:35:52.475118 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 72 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:52.475250 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 FOLLOWER]: Leader election won for term 72
I20260319 16:35:52.475311 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:52.475361 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 71.82, Last appended by leader: 82, Current term: 72, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.475872 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 71 to 72, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 72 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:52.490010 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 71. Current term is 72. Ops: []
I20260319 16:35:52.490288 23713 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 71.82, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260319 16:35:52.490383 23713 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 72.83 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 82
I20260319 16:35:52.490415 23714 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 LEADER]: Stepping down as leader of term 71
I20260319 16:35:52.490458 23714 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:52.490525 23714 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 71.82, Last appended by leader: 82, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.490602 23714 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 71 FOLLOWER]: Advancing to term 72
I20260319 16:35:52.568529 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 72 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 71 index: 82. Preceding OpId from leader: term: 72 index: 83. (index mismatch)
I20260319 16:35:52.568835 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260319 16:35:52.570308 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 72 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 71 index: 82. Preceding OpId from leader: term: 72 index: 83. (index mismatch)
I20260319 16:35:52.570572 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260319 16:35:52.671868 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 72 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:52.671991 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 72 FOLLOWER]: Advancing to term 73
I20260319 16:35:52.673044 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.673202 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 73 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:52.673486 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 73 candidate_status { last_received { term: 72 index: 83 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:52.673580 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 72 FOLLOWER]: Advancing to term 73
I20260319 16:35:52.673482 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 73 candidate_status { last_received { term: 72 index: 83 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:52.674279 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 73.
I20260319 16:35:52.674492 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:52.674610 23709 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 FOLLOWER]: Leader election won for term 73
I20260319 16:35:52.674672 23709 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:52.674727 23709 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 72.83, Last appended by leader: 83, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.675443 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 72 to 73, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 73 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:52.684361 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 72. Current term is 73. Ops: []
I20260319 16:35:52.684741 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 72.83, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260319 16:35:52.684862 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 73.84 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 83
I20260319 16:35:52.684901 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 LEADER]: Stepping down as leader of term 72
I20260319 16:35:52.684927 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:52.684988 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 72.83, Last appended by leader: 83, Current term: 72, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.685072 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 72 FOLLOWER]: Advancing to term 73
I20260319 16:35:52.751479 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 73 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 72 index: 83. Preceding OpId from leader: term: 73 index: 84. (index mismatch)
I20260319 16:35:52.751736 23709 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260319 16:35:52.752853 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 73 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 72 index: 83. Preceding OpId from leader: term: 73 index: 84. (index mismatch)
I20260319 16:35:52.753211 23709 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260319 16:35:52.938361 23714 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 73 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:52.938472 23714 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 73 FOLLOWER]: Advancing to term 74
I20260319 16:35:52.939790 23714 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.940224 23714 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 74 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:52.940495 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 74 candidate_status { last_received { term: 73 index: 84 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:52.940495 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 74 candidate_status { last_received { term: 73 index: 84 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:52.941190 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:52.941426 23714 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260319 16:35:52.942248 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 73. Current term is 74. Ops: []
I20260319 16:35:52.942727 23709 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 73.84, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260319 16:35:52.942941 23712 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 LEADER]: Stepping down as leader of term 73
I20260319 16:35:52.942988 23712 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:52.943053 23712 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 73.84, Last appended by leader: 84, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.943120 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 73 FOLLOWER]: Advancing to term 74
I20260319 16:35:52.976183 23710 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 73 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:52.976326 23710 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 73 FOLLOWER]: Advancing to term 74
I20260319 16:35:52.977991 23710 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.978380 23710 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 74 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:52.978719 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 74 candidate_status { last_received { term: 73 index: 84 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:52.978719 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 74 candidate_status { last_received { term: 73 index: 84 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:52.979009 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 74: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:52.979765 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 74.
I20260319 16:35:52.980154 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 74 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:52.980365 23710 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 FOLLOWER]: Leader election won for term 74
I20260319 16:35:52.980567 23710 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:52.980621 23710 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 73.84, Last appended by leader: 84, Current term: 74, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:52.981634 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 73 to 74, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 74 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:53.071148 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 73 index: 84. Preceding OpId from leader: term: 74 index: 85. (index mismatch)
I20260319 16:35:53.071509 23710 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260319 16:35:53.073064 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 74 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 73 index: 84. Preceding OpId from leader: term: 74 index: 85. (index mismatch)
I20260319 16:35:53.073375 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260319 16:35:53.111346 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:53.173491 23714 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:53.173586 23714 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 74 FOLLOWER]: Advancing to term 75
I20260319 16:35:53.174474 23714 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.174824 23714 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 75 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:53.174969 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 75 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:53.174979 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 75 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:53.175448 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 75 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:53.175558 23714 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Leader election lost for term 75. Reason: could not achieve majority
I20260319 16:35:53.195482 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 74. Current term is 75. Ops: []
I20260319 16:35:53.195919 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 74.85, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260319 16:35:53.196066 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 LEADER]: Stepping down as leader of term 74
I20260319 16:35:53.196087 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:53.196161 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 74.85, Last appended by leader: 85, Current term: 74, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.196269 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 74 FOLLOWER]: Advancing to term 75
I20260319 16:35:53.273280 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 74 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:53.273399 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 74 FOLLOWER]: Advancing to term 75
I20260319 16:35:53.274186 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.274362 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 75 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:53.274670 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 75 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:53.274711 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 75 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:53.274854 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 75: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:53.275550 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 75 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 75.
I20260319 16:35:53.275732 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 75 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:53.276001 23709 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 FOLLOWER]: Leader election won for term 75
I20260319 16:35:53.276077 23709 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:53.276139 23709 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 74.85, Last appended by leader: 85, Current term: 75, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.276733 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 74 to 75, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 75 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:53.285416 23714 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:53.285539 23714 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 75 FOLLOWER]: Advancing to term 76
I20260319 16:35:53.286350 23714 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.286522 23714 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 76 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:53.286760 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 76 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:53.286760 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 76 candidate_status { last_received { term: 74 index: 85 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:53.286960 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 75 FOLLOWER]: Advancing to term 76
I20260319 16:35:53.287669 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 76.
I20260319 16:35:53.287900 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:53.288081 23714 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 FOLLOWER]: Leader election won for term 76
I20260319 16:35:53.288405 23714 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:53.288468 23714 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 74.85, Last appended by leader: 85, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.289273 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 75 to 76, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 76 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:53.367738 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 76 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 74 index: 85. Preceding OpId from leader: term: 76 index: 86. (index mismatch)
I20260319 16:35:53.368294 23714 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260319 16:35:53.369921 23502 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 LEADER]: Stepping down as leader of term 75
I20260319 16:35:53.369985 23502 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:53.370090 23502 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 75.86, Last appended by leader: 86, Current term: 75, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.370213 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 75 FOLLOWER]: Advancing to term 76
I20260319 16:35:53.371039 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 76 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 75 index: 86. Preceding OpId from leader: term: 76 index: 86. (term mismatch)
I20260319 16:35:53.371089 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 85
I20260319 16:35:53.371101 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 75.86
I20260319 16:35:53.371114 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 76 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:53.371520 23716 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260319 16:35:53.569610 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 76 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:53.569818 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 76 FOLLOWER]: Advancing to term 77
I20260319 16:35:53.570498 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.570659 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 77 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:53.570971 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 77 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:53.571000 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 77 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:53.571200 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 77 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:53.571337 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Leader election lost for term 77. Reason: could not achieve majority
I20260319 16:35:53.586017 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 76. Current term is 77. Ops: []
I20260319 16:35:53.586377 23716 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 76.86, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260319 16:35:53.586529 23716 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 LEADER]: Stepping down as leader of term 76
I20260319 16:35:53.586567 23716 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:53.586635 23716 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 76.86, Last appended by leader: 86, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.586719 23716 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 76 FOLLOWER]: Advancing to term 77
I20260319 16:35:53.650130 23712 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 76 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:53.650243 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 76 FOLLOWER]: Advancing to term 77
I20260319 16:35:53.651114 23712 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.651296 23712 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 77 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:53.651539 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 77 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:53.651548 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 77 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:53.651640 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 77: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:53.652298 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 77 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 77.
I20260319 16:35:53.652462 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 77 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:53.652544 23712 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 FOLLOWER]: Leader election won for term 77
I20260319 16:35:53.652595 23712 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:53.652644 23712 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 76.86, Last appended by leader: 86, Current term: 77, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.653183 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 76 to 77, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 77 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:53.692067 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:53.692184 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 77 FOLLOWER]: Advancing to term 78
I20260319 16:35:53.692989 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.693177 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 78 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:53.693403 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 78 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:53.693466 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 77 FOLLOWER]: Advancing to term 78
I20260319 16:35:53.693409 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 78 candidate_status { last_received { term: 76 index: 86 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:53.694087 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 78.
I20260319 16:35:53.694324 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:53.694445 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 FOLLOWER]: Leader election won for term 78
I20260319 16:35:53.694514 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:53.694569 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 76.86, Last appended by leader: 86, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.695312 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 77 to 78, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 78 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:53.729656 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 77. Current term is 78. Ops: []
I20260319 16:35:53.730098 23712 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260319 16:35:53.730216 23712 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 78.87 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 86
I20260319 16:35:53.730245 23712 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 LEADER]: Stepping down as leader of term 77
I20260319 16:35:53.730265 23712 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:53.730342 23712 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 77.87, Last appended by leader: 87, Current term: 77, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.730414 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 77 FOLLOWER]: Advancing to term 78
I20260319 16:35:53.802902 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 78 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 76 index: 86. Preceding OpId from leader: term: 78 index: 87. (index mismatch)
I20260319 16:35:53.803264 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260319 16:35:53.804629 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 78 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 77 index: 87. Preceding OpId from leader: term: 78 index: 87. (term mismatch)
I20260319 16:35:53.804692 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 86
I20260319 16:35:53.804708 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 77.87
I20260319 16:35:53.804725 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 78 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:53.805022 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260319 16:35:53.982928 23716 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 78 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:53.983040 23716 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 78 FOLLOWER]: Advancing to term 79
I20260319 16:35:53.983752 23716 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.983919 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 78. Current term is 79. Ops: []
I20260319 16:35:53.984014 23716 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 79 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:53.984076 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 79 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:53.984189 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 79 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:53.984190 23717 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 78.87, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260319 16:35:53.984385 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 LEADER]: Stepping down as leader of term 78
I20260319 16:35:53.984422 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:53.984431 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 79 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:53.984480 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 78.87, Last appended by leader: 87, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:53.984519 23716 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Leader election lost for term 79. Reason: could not achieve majority
I20260319 16:35:53.984561 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 78 FOLLOWER]: Advancing to term 79
I20260319 16:35:54.006975 23712 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 78 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:54.007087 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 78 FOLLOWER]: Advancing to term 79
I20260319 16:35:54.007773 23712 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.007921 23712 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 79 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:54.008348 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 79 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:54.008450 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 79: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:54.008349 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 79 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.009397 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 79 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 79.
I20260319 16:35:54.009615 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 79 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:54.009721 23712 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 FOLLOWER]: Leader election won for term 79
I20260319 16:35:54.009778 23712 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:54.009819 23712 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 78.87, Last appended by leader: 87, Current term: 79, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.010461 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 78 to 79, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 79 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:54.095211 23716 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:54.095309 23716 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 79 FOLLOWER]: Advancing to term 80
I20260319 16:35:54.096050 23716 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.096346 23716 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 80 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:54.096436 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 80 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.096500 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 79 FOLLOWER]: Advancing to term 80
I20260319 16:35:54.096454 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 80 candidate_status { last_received { term: 78 index: 87 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:54.097179 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 80.
I20260319 16:35:54.097381 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:54.097476 23716 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 FOLLOWER]: Leader election won for term 80
I20260319 16:35:54.097610 23716 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:54.097676 23716 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 78.87, Last appended by leader: 87, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.098357 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 79 to 80, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 80 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:54.112286 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:54.130153 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 79. Current term is 80. Ops: []
I20260319 16:35:54.130462 23712 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260319 16:35:54.130566 23712 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 80.88 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 87
I20260319 16:35:54.130594 23712 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 LEADER]: Stepping down as leader of term 79
I20260319 16:35:54.130613 23712 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:54.130671 23712 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 79.88, Last appended by leader: 88, Current term: 79, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.130740 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 79 FOLLOWER]: Advancing to term 80
I20260319 16:35:54.202262 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 80 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 78 index: 87. Preceding OpId from leader: term: 80 index: 88. (index mismatch)
I20260319 16:35:54.202557 23716 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260319 16:35:54.203704 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 80 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 79 index: 88. Preceding OpId from leader: term: 80 index: 88. (term mismatch)
I20260319 16:35:54.203766 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 87
I20260319 16:35:54.203878 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 79.88
I20260319 16:35:54.203909 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 80 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:54.204161 23718 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260319 16:35:54.382886 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 80 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:54.382992 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 80 FOLLOWER]: Advancing to term 81
I20260319 16:35:54.383694 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.383872 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 81 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:54.384076 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 81 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:54.384142 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 81 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:54.384363 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:54.384454 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260319 16:35:54.402475 23712 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 80 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:54.402573 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 80 FOLLOWER]: Advancing to term 81
I20260319 16:35:54.403283 23712 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.403467 23712 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 81 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:54.403743 23578 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 81 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 80. Current term is 81. Ops: []
I20260319 16:35:54.403720 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 81 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.403733 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 81 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:54.403904 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 81 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 81: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:54.403981 23718 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 80.88, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260319 16:35:54.404083 23718 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 LEADER]: Stepping down as leader of term 80
I20260319 16:35:54.404125 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:54.404134 23718 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:54.404207 23712 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260319 16:35:54.404229 23718 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 80.88, Last appended by leader: 88, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.404415 23718 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 80 FOLLOWER]: Advancing to term 81
I20260319 16:35:54.530661 23712 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 81 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:54.530849 23712 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 81 FOLLOWER]: Advancing to term 82
I20260319 16:35:54.531517 23712 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.531661 23712 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 82 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:54.531947 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 82 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:54.532037 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 81 FOLLOWER]: Advancing to term 82
I20260319 16:35:54.532047 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 82 candidate_status { last_received { term: 80 index: 88 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.532124 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 81 FOLLOWER]: Advancing to term 82
I20260319 16:35:54.532747 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 82.
I20260319 16:35:54.532819 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 82.
I20260319 16:35:54.532977 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:35:54.533087 23712 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 FOLLOWER]: Leader election won for term 82
I20260319 16:35:54.533156 23712 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:54.533202 23712 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 80.88, Last appended by leader: 88, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.533625 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 80 to 82, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 82 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:54.630354 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 82 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 80 index: 88. Preceding OpId from leader: term: 82 index: 89. (index mismatch)
I20260319 16:35:54.630882 23712 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260319 16:35:54.632076 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 82 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 80 index: 88. Preceding OpId from leader: term: 82 index: 89. (index mismatch)
I20260319 16:35:54.632295 23720 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260319 16:35:54.733194 23718 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 82 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:54.733294 23718 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 82 FOLLOWER]: Advancing to term 83
I20260319 16:35:54.734103 23718 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.734284 23718 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 83 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:54.734483 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 83 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:54.734488 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 83 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.734736 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 83 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:54.734879 23718 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Leader election lost for term 83. Reason: could not achieve majority
I20260319 16:35:54.754936 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 82. Current term is 83. Ops: []
I20260319 16:35:54.755209 23712 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 82.89, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260319 16:35:54.755496 23709 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 LEADER]: Stepping down as leader of term 82
I20260319 16:35:54.755544 23709 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:54.755607 23709 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 82.89, Last appended by leader: 89, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.755694 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 82 FOLLOWER]: Advancing to term 83
I20260319 16:35:54.831202 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 82 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:54.831316 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 82 FOLLOWER]: Advancing to term 83
I20260319 16:35:54.832098 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.832335 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 83 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:54.832576 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 83 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:54.832576 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 83 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:54.832703 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 83: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:54.833480 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 83 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 83.
I20260319 16:35:54.833685 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 83 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:54.833782 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 FOLLOWER]: Leader election won for term 83
I20260319 16:35:54.833882 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:54.833928 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 82.89, Last appended by leader: 89, Current term: 83, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.834511 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 82 to 83, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 83 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:54.858412 23718 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:54.858525 23718 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 83 FOLLOWER]: Advancing to term 84
I20260319 16:35:54.859333 23718 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.859615 23718 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 84 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:54.859716 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 84 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:54.859717 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 84 candidate_status { last_received { term: 82 index: 89 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:54.859815 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 83 FOLLOWER]: Advancing to term 84
I20260319 16:35:54.860420 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 84.
I20260319 16:35:54.860822 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:54.860989 23718 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 FOLLOWER]: Leader election won for term 84
I20260319 16:35:54.861039 23718 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:54.861088 23718 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 82.89, Last appended by leader: 89, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.861585 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 83 to 84, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 84 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:54.932148 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 84 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 83. Current term is 84. Ops: []
I20260319 16:35:54.932512 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260319 16:35:54.932638 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 LEADER]: Stepping down as leader of term 83
I20260319 16:35:54.932663 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:54.932744 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 83.90, Last appended by leader: 90, Current term: 83, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:54.932811 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 83 FOLLOWER]: Advancing to term 84
I20260319 16:35:54.973363 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 84 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 83 index: 90. Preceding OpId from leader: term: 84 index: 90. (term mismatch)
I20260319 16:35:54.973462 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 89
I20260319 16:35:54.973476 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 83.90
I20260319 16:35:54.973489 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 84 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:54.973688 23718 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260319 16:35:54.974712 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 84 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 82 index: 89. Preceding OpId from leader: term: 84 index: 90. (index mismatch)
I20260319 16:35:54.974936 23719 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260319 16:35:55.112537 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:55.172112 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 84 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:55.172235 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 84 FOLLOWER]: Advancing to term 85
I20260319 16:35:55.173101 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.173261 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 85 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:55.173535 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 85 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:55.173594 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 85 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:55.173985 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 85 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:55.174113 23709 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Leader election lost for term 85. Reason: could not achieve majority
I20260319 16:35:55.188104 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 84. Current term is 85. Ops: []
I20260319 16:35:55.188450 23719 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 84.90, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260319 16:35:55.188575 23719 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 LEADER]: Stepping down as leader of term 84
I20260319 16:35:55.188593 23719 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:55.188656 23719 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 84.90, Last appended by leader: 90, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.188740 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 84 FOLLOWER]: Advancing to term 85
I20260319 16:35:55.251976 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 84 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:55.252099 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 84 FOLLOWER]: Advancing to term 85
I20260319 16:35:55.252830 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.253010 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 85 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:55.253216 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 85 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:55.253224 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 85 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:55.253342 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 85: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:55.253890 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 85 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 85.
I20260319 16:35:55.254088 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 85 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:55.254180 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 FOLLOWER]: Leader election won for term 85
I20260319 16:35:55.254231 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:55.254283 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 84.90, Last appended by leader: 90, Current term: 85, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.254762 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 84 to 85, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 85 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:55.320638 23709 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:55.320758 23709 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 85 FOLLOWER]: Advancing to term 86
I20260319 16:35:55.321446 23709 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.321600 23709 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 86 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:55.321853 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 86 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:55.321893 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 86 candidate_status { last_received { term: 84 index: 90 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:55.322006 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 85 FOLLOWER]: Advancing to term 86
I20260319 16:35:55.322628 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 86.
I20260319 16:35:55.322885 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:55.322983 23709 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 FOLLOWER]: Leader election won for term 86
I20260319 16:35:55.323130 23709 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:55.323177 23709 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 84.90, Last appended by leader: 90, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.323645 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 85 to 86, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 86 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:55.336603 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 86 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 85. Current term is 86. Ops: []
I20260319 16:35:55.336943 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260319 16:35:55.337060 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 LEADER]: Stepping down as leader of term 85
I20260319 16:35:55.337078 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:55.337134 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 85.91, Last appended by leader: 91, Current term: 85, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.337209 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 85 FOLLOWER]: Advancing to term 86
I20260319 16:35:55.413360 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 86 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 85 index: 91. Preceding OpId from leader: term: 86 index: 91. (term mismatch)
I20260319 16:35:55.413439 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 90
I20260319 16:35:55.413457 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 85.91
I20260319 16:35:55.413475 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 86 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:55.413671 23709 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260319 16:35:55.415233 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 86 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 84 index: 90. Preceding OpId from leader: term: 86 index: 91. (index mismatch)
I20260319 16:35:55.415439 23723 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260319 16:35:55.608846 23719 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 86 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:55.608945 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 86 FOLLOWER]: Advancing to term 87
I20260319 16:35:55.609668 23719 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.609848 23719 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 87 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:55.610090 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 87 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:55.610095 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 87 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:55.610328 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 87 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:55.610467 23719 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Leader election lost for term 87. Reason: could not achieve majority
I20260319 16:35:55.612813 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 86. Current term is 87. Ops: []
I20260319 16:35:55.613080 23723 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 86.91, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260319 16:35:55.613227 23723 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 LEADER]: Stepping down as leader of term 86
I20260319 16:35:55.613257 23723 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:55.613318 23723 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 86.91, Last appended by leader: 91, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.613415 23723 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 86 FOLLOWER]: Advancing to term 87
I20260319 16:35:55.686656 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 86 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:55.686774 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 86 FOLLOWER]: Advancing to term 87
I20260319 16:35:55.687669 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.687860 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 87 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:55.688119 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 87 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:55.688143 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 87 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:55.688215 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 87: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:55.689000 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 87 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 87.
I20260319 16:35:55.689229 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 87 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:55.689337 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 FOLLOWER]: Leader election won for term 87
I20260319 16:35:55.689410 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:55.689463 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 86.91, Last appended by leader: 91, Current term: 87, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.689994 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 86 to 87, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 87 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:55.718935 23719 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:55.719075 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 87 FOLLOWER]: Advancing to term 88
I20260319 16:35:55.719748 23719 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.719926 23719 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 88 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:55.720141 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 88 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:55.720213 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 87 FOLLOWER]: Advancing to term 88
I20260319 16:35:55.720151 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 88 candidate_status { last_received { term: 86 index: 91 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:55.720830 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 88.
I20260319 16:35:55.721025 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:55.721122 23719 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 FOLLOWER]: Leader election won for term 88
I20260319 16:35:55.721248 23719 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:55.721308 23719 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 86.91, Last appended by leader: 91, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.721776 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 87 to 88, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 88 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:55.793716 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 88 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 87. Current term is 88. Ops: []
I20260319 16:35:55.794059 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260319 16:35:55.794193 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 LEADER]: Stepping down as leader of term 87
I20260319 16:35:55.794219 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:55.794276 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 87.92, Last appended by leader: 92, Current term: 87, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.794391 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 87 FOLLOWER]: Advancing to term 88
I20260319 16:35:55.806466 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 88 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 86 index: 91. Preceding OpId from leader: term: 88 index: 92. (index mismatch)
I20260319 16:35:55.806802 23719 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260319 16:35:55.808117 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 88 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 87 index: 92. Preceding OpId from leader: term: 88 index: 92. (term mismatch)
I20260319 16:35:55.808176 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 91
I20260319 16:35:55.808194 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 87.92
I20260319 16:35:55.808211 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 88 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:55.808426 23719 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260319 16:35:55.988623 23723 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 88 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:55.988830 23723 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 88 FOLLOWER]: Advancing to term 89
I20260319 16:35:55.989528 23723 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:55.989732 23723 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 89 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:55.990095 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 89 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:55.990095 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 89 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:55.990486 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 89 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:55.990588 23723 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Leader election lost for term 89. Reason: could not achieve majority
I20260319 16:35:56.006695 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 88. Current term is 89. Ops: []
I20260319 16:35:56.007200 23719 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 88.92, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260319 16:35:56.007352 23719 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 LEADER]: Stepping down as leader of term 88
I20260319 16:35:56.007386 23719 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:56.007578 23719 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 88.92, Last appended by leader: 92, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.007701 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 88 FOLLOWER]: Advancing to term 89
I20260319 16:35:56.020126 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 88 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:56.020251 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 88 FOLLOWER]: Advancing to term 89
I20260319 16:35:56.020974 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.021148 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 89 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:56.021442 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 89 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:56.021438 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 89 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:56.021661 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 89: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:56.022439 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 89.
I20260319 16:35:56.022627 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:56.022742 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 FOLLOWER]: Leader election won for term 89
I20260319 16:35:56.022815 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:56.022862 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 88.92, Last appended by leader: 92, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.023442 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 88 to 89, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 89 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:56.105105 23723 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:56.105211 23723 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 89 FOLLOWER]: Advancing to term 90
I20260319 16:35:56.105888 23723 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.106045 23723 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 90 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:56.106287 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 90 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:56.106356 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 89 FOLLOWER]: Advancing to term 90
I20260319 16:35:56.106316 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 90 candidate_status { last_received { term: 88 index: 92 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:56.106985 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 90.
I20260319 16:35:56.107331 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:56.107455 23723 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 FOLLOWER]: Leader election won for term 90
I20260319 16:35:56.107533 23723 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:56.107590 23723 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 88.92, Last appended by leader: 92, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.108071 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 89 to 90, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 90 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:56.113029 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:56.119952 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 90 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 89. Current term is 90. Ops: []
I20260319 16:35:56.120324 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260319 16:35:56.120445 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 LEADER]: Stepping down as leader of term 89
I20260319 16:35:56.120462 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:56.120507 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 89.93, Last appended by leader: 93, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.120559 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 89 FOLLOWER]: Advancing to term 90
I20260319 16:35:56.193713 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 90 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 89 index: 93. Preceding OpId from leader: term: 90 index: 93. (term mismatch)
I20260319 16:35:56.193823 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 92
I20260319 16:35:56.193845 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 89.93
I20260319 16:35:56.193956 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 90 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:56.194356 23723 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260319 16:35:56.195785 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 90 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 88 index: 92. Preceding OpId from leader: term: 90 index: 93. (index mismatch)
I20260319 16:35:56.196182 23726 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260319 16:35:56.297308 23725 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 90 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:56.297415 23725 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 90 FOLLOWER]: Advancing to term 91
I20260319 16:35:56.298357 23725 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.298648 23725 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 91 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:56.298766 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 91 candidate_status { last_received { term: 90 index: 93 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:56.298821 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 91 candidate_status { last_received { term: 90 index: 93 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:56.298822 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 90 FOLLOWER]: Advancing to term 91
I20260319 16:35:56.299516 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 91 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 91.
I20260319 16:35:56.299723 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 91 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:56.299801 23725 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 FOLLOWER]: Leader election won for term 91
I20260319 16:35:56.299856 23725 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:56.299906 23725 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 90.93, Last appended by leader: 93, Current term: 91, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.300369 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 90 to 91, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 91 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:56.307875 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 91 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 90. Current term is 91. Ops: []
I20260319 16:35:56.308290 23726 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 90.93, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260319 16:35:56.308430 23726 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 LEADER]: Stepping down as leader of term 90
I20260319 16:35:56.308449 23726 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:56.308506 23726 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 90.93, Last appended by leader: 93, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.308589 23726 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 90 FOLLOWER]: Advancing to term 91
I20260319 16:35:56.421989 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 91 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 90 index: 93. Preceding OpId from leader: term: 91 index: 94. (index mismatch)
I20260319 16:35:56.422330 23725 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260319 16:35:56.422861 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 91 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 90 index: 93. Preceding OpId from leader: term: 91 index: 94. (index mismatch)
I20260319 16:35:56.423171 23725 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260319 16:35:56.627434 23726 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 91 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:56.627547 23726 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 91 FOLLOWER]: Advancing to term 92
I20260319 16:35:56.628387 23726 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.628548 23726 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 92 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:56.628823 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 92 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:56.628799 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 92 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:56.629166 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:56.629293 23726 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260319 16:35:56.637409 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 91. Current term is 92. Ops: []
I20260319 16:35:56.637935 23728 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 91.94, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260319 16:35:56.638172 23728 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 LEADER]: Stepping down as leader of term 91
I20260319 16:35:56.638211 23728 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:56.638278 23728 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 91.94, Last appended by leader: 94, Current term: 91, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.638371 23728 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 91 FOLLOWER]: Advancing to term 92
I20260319 16:35:56.715327 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 91 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:56.715509 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 91 FOLLOWER]: Advancing to term 92
I20260319 16:35:56.716306 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.716470 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 92 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:56.716725 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 92 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:56.716725 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 92 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:56.716944 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 92: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:56.717597 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 92 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 92.
I20260319 16:35:56.717805 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 92 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:56.717913 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 FOLLOWER]: Leader election won for term 92
I20260319 16:35:56.718020 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:56.718066 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 91.94, Last appended by leader: 94, Current term: 92, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.718571 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 91 to 92, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 92 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:56.770962 23726 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:56.771080 23726 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 92 FOLLOWER]: Advancing to term 93
I20260319 16:35:56.771726 23726 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.771878 23726 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 93 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:56.772156 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 93 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:56.772205 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 93 candidate_status { last_received { term: 91 index: 94 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:56.772236 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 92 FOLLOWER]: Advancing to term 93
I20260319 16:35:56.772994 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 93.
I20260319 16:35:56.773252 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 93 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:56.773351 23726 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 FOLLOWER]: Leader election won for term 93
I20260319 16:35:56.773418 23726 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:56.773473 23726 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 91.94, Last appended by leader: 94, Current term: 93, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.774119 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 92 to 93, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 93 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:56.827454 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 93 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 92. Current term is 93. Ops: []
I20260319 16:35:56.827821 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260319 16:35:56.827937 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 LEADER]: Stepping down as leader of term 92
I20260319 16:35:56.828015 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:56.828083 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 92.95, Last appended by leader: 95, Current term: 92, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.828159 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 92 FOLLOWER]: Advancing to term 93
I20260319 16:35:56.851661 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 93 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 91 index: 94. Preceding OpId from leader: term: 93 index: 95. (index mismatch)
I20260319 16:35:56.852057 23726 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260319 16:35:56.853224 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 93 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 92 index: 95. Preceding OpId from leader: term: 93 index: 95. (term mismatch)
I20260319 16:35:56.853299 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 94
I20260319 16:35:56.853318 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 92.95
I20260319 16:35:56.853334 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 93 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:56.853499 23726 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260319 16:35:56.954010 23728 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 93 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:56.954108 23728 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 93 FOLLOWER]: Advancing to term 94
I20260319 16:35:56.954851 23728 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.954998 23728 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 94 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:56.955168 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 94 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:56.955180 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 94 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:56.955408 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 94 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:56.955538 23728 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Leader election lost for term 94. Reason: could not achieve majority
I20260319 16:35:56.959255 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 93. Current term is 94. Ops: []
I20260319 16:35:56.959563 23730 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 93.95, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260319 16:35:56.959702 23730 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 LEADER]: Stepping down as leader of term 93
I20260319 16:35:56.959736 23730 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:56.959805 23730 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 93.95, Last appended by leader: 95, Current term: 93, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:56.959903 23730 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 93 FOLLOWER]: Advancing to term 94
I20260319 16:35:57.054944 23729 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 93 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:57.055066 23729 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 93 FOLLOWER]: Advancing to term 94
I20260319 16:35:57.055848 23729 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.056051 23729 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 94 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:57.056349 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 94 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.056360 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 94 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:57.056439 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 94: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:57.057189 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 94.
I20260319 16:35:57.057395 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 94 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:57.057487 23729 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 FOLLOWER]: Leader election won for term 94
I20260319 16:35:57.057535 23729 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:57.057586 23729 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 93.95, Last appended by leader: 95, Current term: 94, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.058017 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 93 to 94, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 94 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:57.105232 23728 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:57.105342 23728 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 94 FOLLOWER]: Advancing to term 95
I20260319 16:35:57.106065 23728 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.106242 23728 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 95 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:57.106453 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 95 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:57.106453 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 95 candidate_status { last_received { term: 93 index: 95 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:57.106550 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 94 FOLLOWER]: Advancing to term 95
I20260319 16:35:57.107141 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 95.
I20260319 16:35:57.107313 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:57.107396 23728 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 FOLLOWER]: Leader election won for term 95
I20260319 16:35:57.107439 23728 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:57.107486 23728 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 93.95, Last appended by leader: 95, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.107885 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 94 to 95, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 95 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:57.113301 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:57.137674 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 94. Current term is 95. Ops: []
I20260319 16:35:57.138064 23729 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260319 16:35:57.138180 23729 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 95.96 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 95
I20260319 16:35:57.138209 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 LEADER]: Stepping down as leader of term 94
I20260319 16:35:57.138249 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:57.138303 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 94.96, Last appended by leader: 96, Current term: 94, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.138422 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 94 FOLLOWER]: Advancing to term 95
I20260319 16:35:57.209609 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 95 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 94 index: 96. Preceding OpId from leader: term: 95 index: 96. (term mismatch)
I20260319 16:35:57.209761 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 95
I20260319 16:35:57.209780 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 94.96
I20260319 16:35:57.209793 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 95 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:57.210114 23728 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260319 16:35:57.210314 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 95 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 93 index: 95. Preceding OpId from leader: term: 95 index: 96. (index mismatch)
I20260319 16:35:57.210503 23728 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260319 16:35:57.401139 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 95 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:57.401243 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 95 FOLLOWER]: Advancing to term 96
I20260319 16:35:57.401973 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.402177 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 96 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:57.402382 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 96 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:57.402396 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 96 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.402590 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 96 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:57.402698 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Leader election lost for term 96. Reason: could not achieve majority
I20260319 16:35:57.413473 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 95. Current term is 96. Ops: []
I20260319 16:35:57.413761 23731 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 95.96, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260319 16:35:57.413903 23731 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 LEADER]: Stepping down as leader of term 95
I20260319 16:35:57.413942 23731 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:57.413993 23731 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 95.96, Last appended by leader: 96, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.414093 23731 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 95 FOLLOWER]: Advancing to term 96
I20260319 16:35:57.487905 23730 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 95 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:57.488016 23730 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 95 FOLLOWER]: Advancing to term 96
I20260319 16:35:57.488749 23730 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.488909 23730 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 96 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:57.489163 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 96 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:57.489163 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 96 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.489275 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 96: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:35:57.489835 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 96 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 96.
I20260319 16:35:57.490064 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 96 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:57.490211 23730 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 FOLLOWER]: Leader election won for term 96
I20260319 16:35:57.490334 23730 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:57.490389 23730 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 95.96, Last appended by leader: 96, Current term: 96, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.490831 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 95 to 96, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 96 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:57.518177 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:57.518307 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 96 FOLLOWER]: Advancing to term 97
I20260319 16:35:57.519011 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.519186 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 97 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:57.519413 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 97 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:57.519435 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 97 candidate_status { last_received { term: 95 index: 96 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.519536 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 96 FOLLOWER]: Advancing to term 97
I20260319 16:35:57.520292 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 97 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 97.
I20260319 16:35:57.520555 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 97 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:57.520702 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 FOLLOWER]: Leader election won for term 97
I20260319 16:35:57.520864 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:57.520931 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 95.96, Last appended by leader: 96, Current term: 97, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.521389 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 96 to 97, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 97 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:57.569613 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 97 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 96. Current term is 97. Ops: []
I20260319 16:35:57.569970 23730 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260319 16:35:57.570091 23730 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 LEADER]: Stepping down as leader of term 96
I20260319 16:35:57.570124 23730 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:57.570183 23730 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 96.97, Last appended by leader: 97, Current term: 96, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.570256 23730 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 96 FOLLOWER]: Advancing to term 97
I20260319 16:35:57.622201 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 97 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 95 index: 96. Preceding OpId from leader: term: 97 index: 97. (index mismatch)
I20260319 16:35:57.622560 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260319 16:35:57.623994 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 97 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 96 index: 97. Preceding OpId from leader: term: 97 index: 97. (term mismatch)
I20260319 16:35:57.624066 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 96
I20260319 16:35:57.624086 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 96.97
I20260319 16:35:57.624102 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 97 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:57.624308 23729 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260319 16:35:57.829263 23732 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 97 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:57.829378 23732 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 97 FOLLOWER]: Advancing to term 98
I20260319 16:35:57.830287 23732 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.830456 23732 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 98 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:57.830734 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 98 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.830794 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 98 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:57.831156 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 98 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:57.831270 23732 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Leader election lost for term 98. Reason: could not achieve majority
I20260319 16:35:57.852108 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 97. Current term is 98. Ops: []
I20260319 16:35:57.852392 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 97.97, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260319 16:35:57.852521 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 LEADER]: Stepping down as leader of term 97
I20260319 16:35:57.852556 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:57.852695 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 97.97, Last appended by leader: 97, Current term: 97, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.852865 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 97 FOLLOWER]: Advancing to term 98
I20260319 16:35:57.895118 23731 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 97 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:57.895291 23731 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 97 FOLLOWER]: Advancing to term 98
I20260319 16:35:57.896140 23731 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.896368 23731 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 98 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:57.896567 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 98 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:57.896606 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 98 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:57.896672 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 98: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:57.897300 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 98.
I20260319 16:35:57.897601 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:57.897717 23731 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 FOLLOWER]: Leader election won for term 98
I20260319 16:35:57.897871 23731 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:57.897943 23731 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 97.97, Last appended by leader: 97, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.898420 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 97 to 98, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 98 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:57.953774 23732 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:57.953927 23732 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 98 FOLLOWER]: Advancing to term 99
I20260319 16:35:57.954641 23732 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.954806 23732 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 99 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:57.955034 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 99 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:57.955119 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 99 candidate_status { last_received { term: 97 index: 97 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:57.955214 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 98 FOLLOWER]: Advancing to term 99
I20260319 16:35:57.955813 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 99.
I20260319 16:35:57.956007 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 99 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:57.956126 23732 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 FOLLOWER]: Leader election won for term 99
I20260319 16:35:57.956203 23732 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:57.956298 23732 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 97.97, Last appended by leader: 97, Current term: 99, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:57.957100 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 98 to 99, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 99 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:58.018175 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 99 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 98. Current term is 99. Ops: []
I20260319 16:35:58.018167 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 98. Current term is 99. Ops: []
I20260319 16:35:58.018539 23719 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260319 16:35:58.018721 23719 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 LEADER]: Stepping down as leader of term 98
I20260319 16:35:58.018733 23731 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260319 16:35:58.018821 23719 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:58.018929 23731 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 99.98 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 97
I20260319 16:35:58.018989 23719 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 98.98, Last appended by leader: 98, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.019075 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 98 FOLLOWER]: Advancing to term 99
I20260319 16:35:58.056434 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 99 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 97 index: 97. Preceding OpId from leader: term: 99 index: 98. (index mismatch)
I20260319 16:35:58.056703 23732 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260319 16:35:58.057907 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 99 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 98 index: 98. Preceding OpId from leader: term: 99 index: 98. (term mismatch)
I20260319 16:35:58.057961 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 97
I20260319 16:35:58.057978 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 98.98
I20260319 16:35:58.057996 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 99 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:58.058148 23730 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260319 16:35:58.113595 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:58.158672 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 99 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:58.158783 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 99 FOLLOWER]: Advancing to term 100
I20260319 16:35:58.159410 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.159577 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 100 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:58.159864 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 100 candidate_status { last_received { term: 99 index: 98 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:58.159888 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 100 candidate_status { last_received { term: 99 index: 98 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:58.160073 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 99 FOLLOWER]: Advancing to term 100
I20260319 16:35:58.160696 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 100.
I20260319 16:35:58.160872 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:58.160992 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 FOLLOWER]: Leader election won for term 100
I20260319 16:35:58.161082 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:58.161123 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 99.98, Last appended by leader: 98, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.161702 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 99 to 100, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 100 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:58.166798 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 100 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 99. Current term is 100. Ops: []
I20260319 16:35:58.167200 23734 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 99.98, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260319 16:35:58.167413 23730 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 LEADER]: Stepping down as leader of term 99
I20260319 16:35:58.167466 23730 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:58.167524 23730 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 99.98, Last appended by leader: 98, Current term: 99, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.167618 23730 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 99 FOLLOWER]: Advancing to term 100
I20260319 16:35:58.280246 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 100 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 99 index: 98. Preceding OpId from leader: term: 100 index: 99. (index mismatch)
I20260319 16:35:58.280591 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260319 16:35:58.281936 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 100 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 99 index: 98. Preceding OpId from leader: term: 100 index: 99. (index mismatch)
I20260319 16:35:58.282203 23729 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260319 16:35:58.382081 23719 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 100 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:58.382189 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 100 FOLLOWER]: Advancing to term 101
I20260319 16:35:58.382887 23719 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.383059 23719 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 101 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:58.383304 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 101 candidate_status { last_received { term: 100 index: 99 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:58.383342 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 101 candidate_status { last_received { term: 100 index: 99 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:58.383448 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 100 FOLLOWER]: Advancing to term 101
I20260319 16:35:58.384093 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 101.
I20260319 16:35:58.384289 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:58.384371 23719 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 FOLLOWER]: Leader election won for term 101
I20260319 16:35:58.384423 23719 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:58.384469 23719 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 100.99, Last appended by leader: 99, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.385000 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 100 to 101, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 101 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:58.399806 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 101 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 100. Current term is 101. Ops: []
I20260319 16:35:58.399911 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 100. Current term is 101. Ops: []
I20260319 16:35:58.400128 23735 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 100.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260319 16:35:58.400277 23729 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 LEADER]: Stepping down as leader of term 100
I20260319 16:35:58.400277 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 100.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260319 16:35:58.400365 23729 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:58.400385 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 101.100 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 99
I20260319 16:35:58.400434 23729 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 100.99, Last appended by leader: 99, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.400508 23729 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 100 FOLLOWER]: Advancing to term 101
I20260319 16:35:58.483651 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 101 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 100 index: 99. Preceding OpId from leader: term: 101 index: 100. (index mismatch)
I20260319 16:35:58.484088 23719 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260319 16:35:58.485271 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 101 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 100 index: 99. Preceding OpId from leader: term: 101 index: 100. (index mismatch)
I20260319 16:35:58.485455 23733 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260319 16:35:58.667958 23734 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 101 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:58.668171 23734 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 101 FOLLOWER]: Advancing to term 102
I20260319 16:35:58.668938 23734 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.669091 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 101. Current term is 102. Ops: []
I20260319 16:35:58.669104 23734 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 102 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:58.669341 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 102 candidate_status { last_received { term: 101 index: 100 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:58.669354 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 102 candidate_status { last_received { term: 101 index: 100 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:58.669469 23733 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 101.100, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260319 16:35:58.669581 23719 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 LEADER]: Stepping down as leader of term 101
I20260319 16:35:58.669611 23719 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:58.669637 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 102 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:58.669659 23719 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 101.100, Last appended by leader: 100, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.669721 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 101 FOLLOWER]: Advancing to term 102
I20260319 16:35:58.669873 23734 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Leader election lost for term 102. Reason: could not achieve majority
I20260319 16:35:58.682839 23729 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 101 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:58.682950 23729 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 101 FOLLOWER]: Advancing to term 102
I20260319 16:35:58.683681 23729 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.683871 23729 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 102 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:58.684085 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 102 candidate_status { last_received { term: 101 index: 100 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:58.684209 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 102: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:58.684085 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 102 candidate_status { last_received { term: 101 index: 100 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:58.684896 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 102 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 102.
I20260319 16:35:58.685168 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 102 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:58.685302 23729 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 FOLLOWER]: Leader election won for term 102
I20260319 16:35:58.685357 23729 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:58.685410 23729 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 101.100, Last appended by leader: 100, Current term: 102, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.686019 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 101 to 102, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 102 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:58.777577 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 101 index: 100. Preceding OpId from leader: term: 102 index: 101. (index mismatch)
I20260319 16:35:58.778012 23729 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260319 16:35:58.780004 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 102 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 101 index: 100. Preceding OpId from leader: term: 102 index: 101. (index mismatch)
I20260319 16:35:58.780328 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260319 16:35:58.989492 23733 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 102 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:58.989606 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 102 FOLLOWER]: Advancing to term 103
I20260319 16:35:58.990463 23733 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.990649 23733 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 103 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:58.990896 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 103 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:58.990935 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 103 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:58.991364 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 103 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:58.991504 23733 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Leader election lost for term 103. Reason: could not achieve majority
I20260319 16:35:58.995908 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 102. Current term is 103. Ops: []
I20260319 16:35:58.996343 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 102.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260319 16:35:58.996470 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 LEADER]: Stepping down as leader of term 102
I20260319 16:35:58.996488 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:58.996603 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 102.101, Last appended by leader: 101, Current term: 102, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:58.996714 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 102 FOLLOWER]: Advancing to term 103
I20260319 16:35:59.052431 23734 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:35:59.052547 23734 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 102 FOLLOWER]: Advancing to term 103
I20260319 16:35:59.053397 23734 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.053550 23734 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 103 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:59.053781 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 103 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:59.053848 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 103: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:59.053881 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 103 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.054534 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 103 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 103.
I20260319 16:35:59.054775 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 103 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:59.054927 23734 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 FOLLOWER]: Leader election won for term 103
I20260319 16:35:59.055075 23734 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:59.055490 23734 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 102.101, Last appended by leader: 101, Current term: 103, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.056177 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 102 to 103, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 103 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:59.100109 23733 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:59.100219 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 103 FOLLOWER]: Advancing to term 104
I20260319 16:35:59.101310 23733 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.101490 23733 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 104 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:59.101766 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 104 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.101842 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 103 FOLLOWER]: Advancing to term 104
I20260319 16:35:59.101840 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 104 candidate_status { last_received { term: 102 index: 101 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:59.102536 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 104.
I20260319 16:35:59.102718 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 104 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:59.102854 23733 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 FOLLOWER]: Leader election won for term 104
I20260319 16:35:59.102908 23733 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:59.102967 23733 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 102.101, Last appended by leader: 101, Current term: 104, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.103528 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 103 to 104, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 104 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:59.113983 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:35:59.167601 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 103. Current term is 104. Ops: []
I20260319 16:35:59.167927 23734 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260319 16:35:59.168159 23734 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 104.102 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 101
I20260319 16:35:59.168216 23734 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 LEADER]: Stepping down as leader of term 103
I20260319 16:35:59.168246 23734 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:59.168363 23734 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 103.102, Last appended by leader: 102, Current term: 103, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.168432 23734 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 103 FOLLOWER]: Advancing to term 104
I20260319 16:35:59.183055 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 104 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 102 index: 101. Preceding OpId from leader: term: 104 index: 102. (index mismatch)
I20260319 16:35:59.183429 23733 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260319 16:35:59.185053 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 104 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 103 index: 102. Preceding OpId from leader: term: 104 index: 102. (term mismatch)
I20260319 16:35:59.185134 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 101
I20260319 16:35:59.185153 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 103.102
I20260319 16:35:59.185169 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 104 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:59.185405 23737 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260319 16:35:59.450327 23736 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 104 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:59.450431 23736 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 104 FOLLOWER]: Advancing to term 105
I20260319 16:35:59.451143 23736 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.451309 23736 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 105 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:59.451512 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 105 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:59.451534 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 105 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.451726 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 105 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:59.451855 23736 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Leader election lost for term 105. Reason: could not achieve majority
I20260319 16:35:59.472548 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 104. Current term is 105. Ops: []
I20260319 16:35:59.472885 23719 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 104.102, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260319 16:35:59.473012 23719 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 LEADER]: Stepping down as leader of term 104
I20260319 16:35:59.473031 23719 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:59.473094 23719 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 104.102, Last appended by leader: 102, Current term: 104, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.473181 23719 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 104 FOLLOWER]: Advancing to term 105
I20260319 16:35:59.553790 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 104 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:35:59.553903 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 104 FOLLOWER]: Advancing to term 105
I20260319 16:35:59.554601 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.554767 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 105 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:59.555014 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 105 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:59.555038 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 105 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:59.555110 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 105: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:35:59.555721 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 105.
I20260319 16:35:59.555899 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 105 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:35:59.556003 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 FOLLOWER]: Leader election won for term 105
I20260319 16:35:59.556102 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:59.556144 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 104.102, Last appended by leader: 102, Current term: 105, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.556862 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 104 to 105, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 105 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:59.558104 23736 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:59.558161 23736 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 105 FOLLOWER]: Advancing to term 106
I20260319 16:35:59.558836 23736 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.558957 23736 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 106 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:35:59.559273 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 106 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:59.559299 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 106 candidate_status { last_received { term: 104 index: 102 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.559370 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 105 FOLLOWER]: Advancing to term 106
I20260319 16:35:59.559947 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 106 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 106.
I20260319 16:35:59.560180 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 106 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:59.560297 23736 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 FOLLOWER]: Leader election won for term 106
I20260319 16:35:59.560349 23736 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:59.560405 23736 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 104.102, Last appended by leader: 102, Current term: 106, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.560952 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 105 to 106, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 106 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:35:59.633803 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 105. Current term is 106. Ops: []
I20260319 16:35:59.634176 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260319 16:35:59.634289 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 106.103 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 102
I20260319 16:35:59.634313 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 LEADER]: Stepping down as leader of term 105
I20260319 16:35:59.634326 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:59.634387 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 105.103, Last appended by leader: 103, Current term: 105, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.634455 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 105 FOLLOWER]: Advancing to term 106
I20260319 16:35:59.675671 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 106 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 105 index: 103. Preceding OpId from leader: term: 106 index: 103. (term mismatch)
I20260319 16:35:59.675828 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 102
I20260319 16:35:59.675841 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 105.103
I20260319 16:35:59.675855 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 106 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:59.676169 23736 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260319 16:35:59.677742 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 106 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 104 index: 102. Preceding OpId from leader: term: 106 index: 103. (index mismatch)
I20260319 16:35:59.677983 23736 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260319 16:35:59.779022 23733 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 106 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:59.779134 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 106 FOLLOWER]: Advancing to term 107
I20260319 16:35:59.779786 23733 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.779953 23733 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 107 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:59.780172 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 107 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.780184 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 107 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:59.780437 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:59.780536 23733 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260319 16:35:59.802735 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 106. Current term is 107. Ops: []
I20260319 16:35:59.803092 23739 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 106.103, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260319 16:35:59.803241 23739 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 LEADER]: Stepping down as leader of term 106
I20260319 16:35:59.803295 23739 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:35:59.803385 23739 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 106.103, Last appended by leader: 103, Current term: 106, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.803547 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 106 FOLLOWER]: Advancing to term 107
I20260319 16:35:59.870174 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 106 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:35:59.870288 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 106 FOLLOWER]: Advancing to term 107
I20260319 16:35:59.870999 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.871220 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 107 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:59.871443 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 107 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:59.871471 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 107 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:35:59.871569 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 107: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:35:59.872105 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 107 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 107.
I20260319 16:35:59.872354 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 107 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:35:59.872437 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 FOLLOWER]: Leader election won for term 107
I20260319 16:35:59.872485 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:59.872538 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 106.103, Last appended by leader: 103, Current term: 107, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.873260 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 106 to 107, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 107 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:59.888038 23733 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:35:59.888154 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 107 FOLLOWER]: Advancing to term 108
I20260319 16:35:59.888938 23733 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.889117 23733 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 108 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:35:59.889341 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 108 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:35:59.889366 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 108 candidate_status { last_received { term: 106 index: 103 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:35:59.889436 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 107 FOLLOWER]: Advancing to term 108
I20260319 16:35:59.890017 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 108.
I20260319 16:35:59.890267 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:35:59.890390 23733 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 FOLLOWER]: Leader election won for term 108
I20260319 16:35:59.890441 23733 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:35:59.890491 23733 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 106.103, Last appended by leader: 103, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.891036 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 107 to 108, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 108 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:35:59.974543 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 108 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 106 index: 103. Preceding OpId from leader: term: 108 index: 104. (index mismatch)
I20260319 16:35:59.974830 23733 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260319 16:35:59.976002 23579 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 LEADER]: Stepping down as leader of term 107
I20260319 16:35:59.976068 23579 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:35:59.976114 23579 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 107.104, Last appended by leader: 104, Current term: 107, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:35:59.976186 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 107 FOLLOWER]: Advancing to term 108
I20260319 16:35:59.976819 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 108 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 107 index: 104. Preceding OpId from leader: term: 108 index: 104. (term mismatch)
I20260319 16:35:59.976858 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 103
I20260319 16:35:59.976869 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 107.104
I20260319 16:35:59.976881 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 108 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:35:59.977105 23740 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260319 16:36:00.076615 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 108 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:00.076723 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 108 FOLLOWER]: Advancing to term 109
I20260319 16:36:00.077508 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.077669 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 109 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:00.077960 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 109 candidate_status { last_received { term: 108 index: 104 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.078112 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 109 candidate_status { last_received { term: 108 index: 104 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.078333 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 109 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:00.078421 23739 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 109 FOLLOWER]: Leader election lost for term 109. Reason: could not achieve majority
I20260319 16:36:00.096689 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 109 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 108. Current term is 109. Ops: []
I20260319 16:36:00.096992 23733 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 108.104, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260319 16:36:00.097113 23733 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 LEADER]: Stepping down as leader of term 108
I20260319 16:36:00.097131 23733 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:00.097177 23733 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 108.104, Last appended by leader: 104, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.097255 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 108 FOLLOWER]: Advancing to term 109
I20260319 16:36:00.114274 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:00.198385 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 109 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:00.198493 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 109 FOLLOWER]: Advancing to term 110
I20260319 16:36:00.199239 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.199416 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 110 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:00.199815 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 110 candidate_status { last_received { term: 108 index: 104 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.199838 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 110 candidate_status { last_received { term: 108 index: 104 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.199940 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 108 FOLLOWER]: Advancing to term 110
I20260319 16:36:00.199949 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 109 FOLLOWER]: Advancing to term 110
I20260319 16:36:00.200867 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 110.
I20260319 16:36:00.200867 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 110.
I20260319 16:36:00.201140 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 110 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters:
I20260319 16:36:00.201267 23739 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 FOLLOWER]: Leader election won for term 110
I20260319 16:36:00.201332 23739 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:00.201385 23739 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 108.104, Last appended by leader: 104, Current term: 110, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.202355 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 108 to 110, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 110 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:00.277437 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 110 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 108 index: 104. Preceding OpId from leader: term: 110 index: 105. (index mismatch)
I20260319 16:36:00.277813 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260319 16:36:00.279150 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 110 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 108 index: 104. Preceding OpId from leader: term: 110 index: 105. (index mismatch)
I20260319 16:36:00.279462 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260319 16:36:00.379277 23733 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 110 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:00.379387 23733 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 110 FOLLOWER]: Advancing to term 111
I20260319 16:36:00.380100 23733 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.380298 23738 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 110 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:00.380326 23733 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 111 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:00.380352 23738 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 110 FOLLOWER]: Advancing to term 111
I20260319 16:36:00.380539 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 111 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:00.380543 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 111 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.381210 23738 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.381336 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 111 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 111: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:00.381367 23738 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 111 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:00.381554 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 111 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:00.381560 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 111 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:00.381565 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 111 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.381758 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 111 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 111: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:00.381827 23733 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 111 FOLLOWER]: Leader election lost for term 111. Reason: could not achieve majority
I20260319 16:36:00.381913 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 111 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:00.382014 23738 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 111 FOLLOWER]: Leader election lost for term 111. Reason: could not achieve majority
I20260319 16:36:00.397141 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 111 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 110. Current term is 111. Ops: []
I20260319 16:36:00.397436 23739 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 110.105, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260319 16:36:00.397562 23739 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 LEADER]: Stepping down as leader of term 110
I20260319 16:36:00.397580 23739 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:00.397683 23739 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 110.105, Last appended by leader: 105, Current term: 110, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.397818 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 110 FOLLOWER]: Advancing to term 111
I20260319 16:36:00.514605 23738 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 111 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:00.514789 23738 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 111 FOLLOWER]: Advancing to term 112
I20260319 16:36:00.515511 23738 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.515677 23738 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 112 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:00.515937 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 112 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:00.516011 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 111 FOLLOWER]: Advancing to term 112
I20260319 16:36:00.515941 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 112 candidate_status { last_received { term: 110 index: 105 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.516060 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 111 FOLLOWER]: Advancing to term 112
I20260319 16:36:00.516592 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 112.
I20260319 16:36:00.516721 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 112.
I20260319 16:36:00.516911 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 112 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters:
I20260319 16:36:00.517038 23738 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 FOLLOWER]: Leader election won for term 112
I20260319 16:36:00.517100 23738 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:00.517146 23738 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 110.105, Last appended by leader: 105, Current term: 112, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.517612 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 110 to 112, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 112 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:00.599548 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 112 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 110 index: 105. Preceding OpId from leader: term: 112 index: 106. (index mismatch)
I20260319 16:36:00.599900 23738 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260319 16:36:00.601439 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 112 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 110 index: 105. Preceding OpId from leader: term: 112 index: 106. (index mismatch)
I20260319 16:36:00.601747 23742 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260319 16:36:00.702212 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 112 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:00.702319 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 112 FOLLOWER]: Advancing to term 113
I20260319 16:36:00.703689 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.703898 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 113 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:00.704144 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 113 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.704144 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 113 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.704437 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 113 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:00.704520 23739 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Leader election lost for term 113. Reason: could not achieve majority
I20260319 16:36:00.706988 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 112. Current term is 113. Ops: []
I20260319 16:36:00.707221 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 112.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260319 16:36:00.707332 23704 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 LEADER]: Stepping down as leader of term 112
I20260319 16:36:00.707365 23704 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:00.707417 23704 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 112.106, Last appended by leader: 106, Current term: 112, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.707500 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 112 FOLLOWER]: Advancing to term 113
I20260319 16:36:00.783936 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 112 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:00.784061 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 112 FOLLOWER]: Advancing to term 113
I20260319 16:36:00.784940 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.785125 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 113 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:00.785355 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 113 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.785362 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 113 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:00.785470 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 113: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:00.786051 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 113.
I20260319 16:36:00.786319 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:00.786453 23743 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 FOLLOWER]: Leader election won for term 113
I20260319 16:36:00.786525 23743 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:00.786589 23743 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 112.106, Last appended by leader: 106, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.787273 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 112 to 113, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 113 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:00.839998 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:00.840142 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 113 FOLLOWER]: Advancing to term 114
I20260319 16:36:00.840813 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.840951 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 114 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:00.841174 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 114 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:00.841256 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 114 candidate_status { last_received { term: 112 index: 106 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:00.841348 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 113 FOLLOWER]: Advancing to term 114
I20260319 16:36:00.841886 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 114 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 114.
I20260319 16:36:00.842139 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 114 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:00.842239 23739 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 FOLLOWER]: Leader election won for term 114
I20260319 16:36:00.842294 23739 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:00.842346 23739 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 112.106, Last appended by leader: 106, Current term: 114, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.842821 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 113 to 114, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 114 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:00.896335 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 114 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 113. Current term is 114. Ops: []
I20260319 16:36:00.896750 23743 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260319 16:36:00.896970 23743 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 LEADER]: Stepping down as leader of term 113
I20260319 16:36:00.897126 23743 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:00.897300 23743 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 113.107, Last appended by leader: 107, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:00.897416 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 113 FOLLOWER]: Advancing to term 114
I20260319 16:36:00.936591 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 114 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 113 index: 107. Preceding OpId from leader: term: 114 index: 107. (term mismatch)
I20260319 16:36:00.936676 23427 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 106
I20260319 16:36:00.936690 23427 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 113.107
I20260319 16:36:00.936704 23427 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 114 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:00.937196 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260319 16:36:00.938536 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 114 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 112 index: 106. Preceding OpId from leader: term: 114 index: 107. (index mismatch)
I20260319 16:36:00.938757 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260319 16:36:01.114576 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:01.126791 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 114 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:01.126909 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 114 FOLLOWER]: Advancing to term 115
I20260319 16:36:01.127595 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.127769 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 115 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.128108 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 115 candidate_status { last_received { term: 114 index: 107 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.128140 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 115 candidate_status { last_received { term: 114 index: 107 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.128378 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 115 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:01.128472 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Leader election lost for term 115. Reason: could not achieve majority
I20260319 16:36:01.134153 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 114. Current term is 115. Ops: []
I20260319 16:36:01.134456 23739 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 114.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260319 16:36:01.134580 23741 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 LEADER]: Stepping down as leader of term 114
I20260319 16:36:01.134621 23741 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:01.134690 23741 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 114.107, Last appended by leader: 107, Current term: 114, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.134975 23741 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 114 FOLLOWER]: Advancing to term 115
I20260319 16:36:01.142201 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 114 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:01.142309 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 114 FOLLOWER]: Advancing to term 115
I20260319 16:36:01.143006 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.143213 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 115 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.143450 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 115 candidate_status { last_received { term: 114 index: 107 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:01.143523 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 115 candidate_status { last_received { term: 114 index: 107 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.143616 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 115: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:01.144356 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 115 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 115.
I20260319 16:36:01.144563 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 115 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:01.144683 23743 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 FOLLOWER]: Leader election won for term 115
I20260319 16:36:01.144747 23743 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:01.144894 23743 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 114.107, Last appended by leader: 107, Current term: 115, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.145471 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 114 to 115, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 115 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:01.223382 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 114 index: 107. Preceding OpId from leader: term: 115 index: 108. (index mismatch)
I20260319 16:36:01.223716 23743 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260319 16:36:01.224952 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 115 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 114 index: 107. Preceding OpId from leader: term: 115 index: 108. (index mismatch)
I20260319 16:36:01.225181 23745 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260319 16:36:01.325309 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:01.325423 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 115 FOLLOWER]: Advancing to term 116
I20260319 16:36:01.326212 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.326395 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 116 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.326620 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 116 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.326620 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 116 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.326974 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:01.327139 23704 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260319 16:36:01.327539 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 115. Current term is 116. Ops: []
I20260319 16:36:01.327847 23743 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 115.108, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260319 16:36:01.327951 23743 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 LEADER]: Stepping down as leader of term 115
I20260319 16:36:01.328051 23743 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:01.328126 23743 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 115.108, Last appended by leader: 108, Current term: 115, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.328310 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 115 FOLLOWER]: Advancing to term 116
I20260319 16:36:01.411463 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 115 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:01.411573 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 115 FOLLOWER]: Advancing to term 116
I20260319 16:36:01.412384 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.412539 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 116 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:01.412830 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 116 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.412992 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 116 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:01.413076 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 116: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:01.413604 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 116 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 116.
I20260319 16:36:01.413791 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 116 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:01.413878 23739 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 FOLLOWER]: Leader election won for term 116
I20260319 16:36:01.413928 23739 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:01.413966 23739 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 115.108, Last appended by leader: 108, Current term: 116, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.414472 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 115 to 116, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 116 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:01.475664 23704 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:01.475780 23704 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 116 FOLLOWER]: Advancing to term 117
I20260319 16:36:01.476660 23704 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.476835 23704 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 117 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.477061 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 117 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.477072 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 117 candidate_status { last_received { term: 115 index: 108 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.477155 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 116 FOLLOWER]: Advancing to term 117
I20260319 16:36:01.477780 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 117.
I20260319 16:36:01.477952 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 117 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:01.478035 23704 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 FOLLOWER]: Leader election won for term 117
I20260319 16:36:01.478135 23704 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:01.478179 23704 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 115.108, Last appended by leader: 108, Current term: 117, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.478705 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 116 to 117, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 117 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:01.494288 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 117 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 116. Current term is 117. Ops: []
I20260319 16:36:01.494582 23739 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260319 16:36:01.494858 23739 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 LEADER]: Stepping down as leader of term 116
I20260319 16:36:01.494925 23739 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:01.494997 23739 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 116.109, Last appended by leader: 109, Current term: 116, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.495095 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 116 FOLLOWER]: Advancing to term 117
I20260319 16:36:01.557332 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 117 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 116 index: 109. Preceding OpId from leader: term: 117 index: 109. (term mismatch)
I20260319 16:36:01.557420 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 108
I20260319 16:36:01.557433 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 116.109
I20260319 16:36:01.557446 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 117 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:01.557724 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260319 16:36:01.559202 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 117 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 115 index: 108. Preceding OpId from leader: term: 117 index: 109. (index mismatch)
I20260319 16:36:01.559379 23704 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260319 16:36:01.660910 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 117 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:01.661027 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 117 FOLLOWER]: Advancing to term 118
I20260319 16:36:01.661716 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.661904 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 118 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.662143 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 118 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.662143 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 118 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:01.662420 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 118 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:01.662554 23743 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Leader election lost for term 118. Reason: could not achieve majority
I20260319 16:36:01.684759 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 117. Current term is 118. Ops: []
I20260319 16:36:01.685163 23747 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 117.109, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260319 16:36:01.685284 23747 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 LEADER]: Stepping down as leader of term 117
I20260319 16:36:01.685302 23747 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:01.685354 23747 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 117.109, Last appended by leader: 109, Current term: 117, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.685441 23747 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 117 FOLLOWER]: Advancing to term 118
I20260319 16:36:01.756943 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 117 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:01.757071 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 117 FOLLOWER]: Advancing to term 118
I20260319 16:36:01.757975 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.758147 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 118 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:01.758428 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 118 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:01.758452 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 118 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.758637 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 118: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:01.759353 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 118 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 118.
I20260319 16:36:01.759624 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 118 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:01.759740 23739 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 FOLLOWER]: Leader election won for term 118
I20260319 16:36:01.759814 23739 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:01.759877 23739 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 117.109, Last appended by leader: 109, Current term: 118, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.760479 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 117 to 118, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 118 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:01.775125 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:01.775251 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 118 FOLLOWER]: Advancing to term 119
I20260319 16:36:01.775945 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.776116 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 119 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.776358 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 119 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:01.776448 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 118 FOLLOWER]: Advancing to term 119
I20260319 16:36:01.776371 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 119 candidate_status { last_received { term: 117 index: 109 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.777158 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 119 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 119.
I20260319 16:36:01.777362 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 119 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:01.777486 23743 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 FOLLOWER]: Leader election won for term 119
I20260319 16:36:01.777575 23743 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:01.777629 23743 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 117.109, Last appended by leader: 109, Current term: 119, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.778218 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 118 to 119, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 119 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:01.869725 23502 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 LEADER]: Stepping down as leader of term 118
I20260319 16:36:01.869819 23502 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:01.869894 23502 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 118.110, Last appended by leader: 110, Current term: 118, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.869988 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 118 FOLLOWER]: Advancing to term 119
I20260319 16:36:01.870661 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 119 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 118 index: 110. Preceding OpId from leader: term: 119 index: 110. (term mismatch)
I20260319 16:36:01.870703 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 109
I20260319 16:36:01.870813 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 118.110
I20260319 16:36:01.870842 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 119 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:01.871212 23743 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260319 16:36:01.872512 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 119 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 117 index: 109. Preceding OpId from leader: term: 119 index: 110. (index mismatch)
I20260319 16:36:01.872961 23743 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260319 16:36:01.974360 23747 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 119 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:01.974474 23747 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 119 FOLLOWER]: Advancing to term 120
I20260319 16:36:01.975262 23747 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.975437 23747 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 120 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:01.975623 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 120 candidate_status { last_received { term: 119 index: 110 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:01.975666 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 120 candidate_status { last_received { term: 119 index: 110 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:01.975865 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 119 FOLLOWER]: Advancing to term 120
I20260319 16:36:01.976468 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 120.
I20260319 16:36:01.976655 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:01.976783 23747 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 FOLLOWER]: Leader election won for term 120
I20260319 16:36:01.976861 23747 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:01.976919 23747 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 119.110, Last appended by leader: 110, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.977487 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 119 to 120, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 120 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:01.995214 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 119. Current term is 120. Ops: []
I20260319 16:36:01.995538 23745 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 119.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260319 16:36:01.995654 23745 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 120.111 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 110
I20260319 16:36:01.995679 23745 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 LEADER]: Stepping down as leader of term 119
I20260319 16:36:01.995697 23745 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:01.995760 23745 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 119.110, Last appended by leader: 110, Current term: 119, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:01.995846 23745 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 119 FOLLOWER]: Advancing to term 120
I20260319 16:36:02.059193 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 120 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 119 index: 110. Preceding OpId from leader: term: 120 index: 111. (index mismatch)
I20260319 16:36:02.059499 23747 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260319 16:36:02.060557 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 120 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 119 index: 110. Preceding OpId from leader: term: 120 index: 111. (index mismatch)
I20260319 16:36:02.060731 23747 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260319 16:36:02.114888 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:02.161126 23739 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 120 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:02.161240 23739 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 120 FOLLOWER]: Advancing to term 121
I20260319 16:36:02.161952 23739 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.162114 23739 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 121 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:02.162353 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 121 candidate_status { last_received { term: 120 index: 111 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:02.162413 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 120 FOLLOWER]: Advancing to term 121
I20260319 16:36:02.162456 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 121 candidate_status { last_received { term: 120 index: 111 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:02.163172 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 121 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 121.
I20260319 16:36:02.163374 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 121 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:02.163458 23739 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 FOLLOWER]: Leader election won for term 121
I20260319 16:36:02.163502 23739 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:02.163543 23739 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 120.111, Last appended by leader: 111, Current term: 121, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.164065 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 120 to 121, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 121 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:02.168280 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 121 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 120. Current term is 121. Ops: []
I20260319 16:36:02.168283 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 120. Current term is 121. Ops: []
I20260319 16:36:02.168548 23747 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 120.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260319 16:36:02.168673 23746 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 LEADER]: Stepping down as leader of term 120
I20260319 16:36:02.168706 23746 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:02.168713 23704 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 120.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260319 16:36:02.168819 23704 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 121.112 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 111
I20260319 16:36:02.168876 23746 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 120.111, Last appended by leader: 111, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.168958 23746 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 120 FOLLOWER]: Advancing to term 121
I20260319 16:36:02.262436 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 121 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 120 index: 111. Preceding OpId from leader: term: 121 index: 112. (index mismatch)
I20260319 16:36:02.262786 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260319 16:36:02.264477 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 121 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 120 index: 111. Preceding OpId from leader: term: 121 index: 112. (index mismatch)
I20260319 16:36:02.264951 23739 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260319 16:36:02.366154 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 121 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:02.366261 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 121 FOLLOWER]: Advancing to term 122
I20260319 16:36:02.367058 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.367216 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 122 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:02.367489 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 122 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:02.367489 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 122 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:02.367887 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 122 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:02.368062 23743 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Leader election lost for term 122. Reason: could not achieve majority
I20260319 16:36:02.380434 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 121. Current term is 122. Ops: []
I20260319 16:36:02.380729 23741 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 121.112, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260319 16:36:02.380867 23741 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 LEADER]: Stepping down as leader of term 121
I20260319 16:36:02.380896 23741 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:02.380954 23741 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 121.112, Last appended by leader: 112, Current term: 121, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.381040 23741 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 121 FOLLOWER]: Advancing to term 122
I20260319 16:36:02.455325 23746 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 121 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:02.455442 23746 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 121 FOLLOWER]: Advancing to term 122
I20260319 16:36:02.456228 23746 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.456432 23746 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 122 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:02.456704 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 122 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:02.456758 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 122 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:02.456841 23427 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 122: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:02.457477 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 122.
I20260319 16:36:02.457657 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 122 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:02.457749 23746 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 FOLLOWER]: Leader election won for term 122
I20260319 16:36:02.457798 23746 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:02.457851 23746 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 121.112, Last appended by leader: 112, Current term: 122, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.458400 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 121 to 122, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 122 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:02.481277 23743 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:02.481388 23743 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 122 FOLLOWER]: Advancing to term 123
I20260319 16:36:02.482219 23743 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.482393 23743 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 123 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:02.482645 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 123 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:02.482776 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 123 candidate_status { last_received { term: 121 index: 112 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:02.482895 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 122 FOLLOWER]: Advancing to term 123
I20260319 16:36:02.483469 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 123 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 123.
I20260319 16:36:02.483731 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 123 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:02.483949 23743 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 FOLLOWER]: Leader election won for term 123
I20260319 16:36:02.484025 23743 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:02.484097 23743 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 121.112, Last appended by leader: 112, Current term: 123, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.484596 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 122 to 123, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 123 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:02.537324 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 122. Current term is 123. Ops: []
I20260319 16:36:02.537659 23746 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260319 16:36:02.537853 23746 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 123.113 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 112
I20260319 16:36:02.537889 23747 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 LEADER]: Stepping down as leader of term 122
I20260319 16:36:02.537930 23747 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:02.538044 23747 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 122.113, Last appended by leader: 113, Current term: 122, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.538115 23747 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 122 FOLLOWER]: Advancing to term 123
I20260319 16:36:02.591370 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 123 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 121 index: 112. Preceding OpId from leader: term: 123 index: 113. (index mismatch)
I20260319 16:36:02.591689 23743 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260319 16:36:02.593014 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 123 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 122 index: 113. Preceding OpId from leader: term: 123 index: 113. (term mismatch)
I20260319 16:36:02.593086 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 112
I20260319 16:36:02.593106 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 122.113
I20260319 16:36:02.593122 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 123 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:02.593326 23743 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260319 16:36:02.782076 23741 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 123 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:02.782191 23741 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 123 FOLLOWER]: Advancing to term 124
I20260319 16:36:02.783021 23741 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.783191 23741 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 124 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:02.783450 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 124 candidate_status { last_received { term: 123 index: 113 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:02.783499 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 124 candidate_status { last_received { term: 123 index: 113 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:02.783703 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 124 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:02.783843 23741 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Leader election lost for term 124. Reason: could not achieve majority
I20260319 16:36:02.792467 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 123. Current term is 124. Ops: []
I20260319 16:36:02.792946 23743 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 123.113, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260319 16:36:02.793120 23745 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 LEADER]: Stepping down as leader of term 123
I20260319 16:36:02.793162 23745 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:02.793220 23745 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 123.113, Last appended by leader: 113, Current term: 123, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.793300 23745 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 123 FOLLOWER]: Advancing to term 124
I20260319 16:36:02.802804 23746 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 123 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:02.802922 23746 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 123 FOLLOWER]: Advancing to term 124
I20260319 16:36:02.803701 23746 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.803889 23746 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 124 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:02.804090 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 124 candidate_status { last_received { term: 123 index: 113 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:02.804194 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 124: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:02.804090 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 124 candidate_status { last_received { term: 123 index: 113 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:02.804994 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 124.
I20260319 16:36:02.805238 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 124 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:02.805351 23746 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 FOLLOWER]: Leader election won for term 124
I20260319 16:36:02.805402 23746 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:02.805455 23746 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 123.113, Last appended by leader: 113, Current term: 124, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.806214 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 123 to 124, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 124 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:02.890635 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 123 index: 113. Preceding OpId from leader: term: 124 index: 114. (index mismatch)
I20260319 16:36:02.890933 23746 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260319 16:36:02.892362 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 124 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 123 index: 113. Preceding OpId from leader: term: 124 index: 114. (index mismatch)
I20260319 16:36:02.892580 23746 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260319 16:36:02.992506 23741 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:02.992626 23741 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 124 FOLLOWER]: Advancing to term 125
I20260319 16:36:02.993435 23741 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.993605 23741 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 125 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:02.994052 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 125 candidate_status { last_received { term: 124 index: 114 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:02.994047 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 125 candidate_status { last_received { term: 124 index: 114 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:02.994412 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 124 FOLLOWER]: Advancing to term 125
I20260319 16:36:02.995167 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 125 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 125.
I20260319 16:36:02.995369 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 125 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:02.995476 23741 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 FOLLOWER]: Leader election won for term 125
I20260319 16:36:02.995597 23741 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:02.995663 23741 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 124.114, Last appended by leader: 114, Current term: 125, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:02.996189 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 124 to 125, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 125 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:03.002969 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 125 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 124. Current term is 125. Ops: []
I20260319 16:36:03.003253 23751 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 124.114, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260319 16:36:03.003360 23751 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 LEADER]: Stepping down as leader of term 124
I20260319 16:36:03.003389 23751 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:03.003453 23751 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 124.114, Last appended by leader: 114, Current term: 124, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.003528 23751 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 124 FOLLOWER]: Advancing to term 125
I20260319 16:36:03.076889 23427 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 125 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 124 index: 114. Preceding OpId from leader: term: 125 index: 115. (index mismatch)
I20260319 16:36:03.077225 23741 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260319 16:36:03.078392 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 125 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 124 index: 114. Preceding OpId from leader: term: 125 index: 115. (index mismatch)
I20260319 16:36:03.078583 23752 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260319 16:36:03.115227 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:03.179307 23745 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 125 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:03.179422 23745 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 125 FOLLOWER]: Advancing to term 126
I20260319 16:36:03.180160 23745 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.180364 23745 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 126 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:03.180588 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 126 candidate_status { last_received { term: 125 index: 115 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:03.180593 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 126 candidate_status { last_received { term: 125 index: 115 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:03.180851 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 125 FOLLOWER]: Advancing to term 126
I20260319 16:36:03.181533 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 126 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 126.
I20260319 16:36:03.181770 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 126 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:03.181861 23745 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 FOLLOWER]: Leader election won for term 126
I20260319 16:36:03.181922 23745 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:03.181962 23745 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 125.115, Last appended by leader: 115, Current term: 126, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.182260 23427 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 125. Current term is 126. Ops: []
I20260319 16:36:03.182451 23752 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 125.115, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260319 16:36:03.182446 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 125 to 126, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 126 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:03.182571 23752 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 126.116 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 115
I20260319 16:36:03.182601 23750 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 LEADER]: Stepping down as leader of term 125
I20260319 16:36:03.182632 23750 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:03.182705 23750 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 125.115, Last appended by leader: 115, Current term: 125, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.182797 23750 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 125 FOLLOWER]: Advancing to term 126
I20260319 16:36:03.282276 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 126 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 125 index: 115. Preceding OpId from leader: term: 126 index: 116. (index mismatch)
I20260319 16:36:03.282558 23745 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260319 16:36:03.283855 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 126 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 125 index: 115. Preceding OpId from leader: term: 126 index: 116. (index mismatch)
I20260319 16:36:03.284188 23753 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260319 16:36:03.468092 23751 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 126 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:03.468209 23751 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 126 FOLLOWER]: Advancing to term 127
I20260319 16:36:03.469090 23751 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.469273 23751 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 127 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:03.469506 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 127 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:03.469538 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 127 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:03.469859 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 127 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:03.469987 23751 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Leader election lost for term 127. Reason: could not achieve majority
I20260319 16:36:03.471166 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 126. Current term is 127. Ops: []
I20260319 16:36:03.471485 23753 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 126.116, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260319 16:36:03.471632 23753 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 LEADER]: Stepping down as leader of term 126
I20260319 16:36:03.471662 23753 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:03.471712 23753 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 126.116, Last appended by leader: 116, Current term: 126, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.471793 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 126 FOLLOWER]: Advancing to term 127
I20260319 16:36:03.500028 23750 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 126 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:03.500144 23750 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 126 FOLLOWER]: Advancing to term 127
I20260319 16:36:03.501029 23750 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.501205 23750 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 127 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:03.501412 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 127 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:03.501565 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 127 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:03.501729 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 127: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:03.502303 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 127 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 127.
I20260319 16:36:03.502496 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 127 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:03.502584 23750 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 FOLLOWER]: Leader election won for term 127
I20260319 16:36:03.502635 23750 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:03.502693 23750 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 126.116, Last appended by leader: 116, Current term: 127, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.503216 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 126 to 127, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 127 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:03.589620 23751 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:03.589733 23751 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 127 FOLLOWER]: Advancing to term 128
I20260319 16:36:03.590485 23751 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.590657 23751 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 128 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:03.591049 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 128 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:03.591044 23427 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 128 candidate_status { last_received { term: 126 index: 116 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:03.591195 23427 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 127 FOLLOWER]: Advancing to term 128
I20260319 16:36:03.591926 23427 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 128.
I20260319 16:36:03.592017 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 128 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 127. Current term is 128. Ops: []
I20260319 16:36:03.592185 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:03.592334 23751 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 FOLLOWER]: Leader election won for term 128
I20260319 16:36:03.592341 23750 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260319 16:36:03.592448 23751 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:03.592507 23750 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 LEADER]: Stepping down as leader of term 127
I20260319 16:36:03.592495 23751 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 126.116, Last appended by leader: 116, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.592547 23750 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:03.592597 23750 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 127.117, Last appended by leader: 117, Current term: 127, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.592661 23750 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 127 FOLLOWER]: Advancing to term 128
I20260319 16:36:03.593065 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 127 to 128, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 128 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:03.711686 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 128 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 126 index: 116. Preceding OpId from leader: term: 128 index: 117. (index mismatch)
I20260319 16:36:03.712081 23751 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260319 16:36:03.713186 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 128 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 127 index: 117. Preceding OpId from leader: term: 128 index: 117. (term mismatch)
I20260319 16:36:03.713246 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 116
I20260319 16:36:03.713265 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 127.117
I20260319 16:36:03.713287 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 128 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:03.713444 23751 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260319 16:36:03.981891 23750 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 128 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:03.982012 23750 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 128 FOLLOWER]: Advancing to term 129
I20260319 16:36:03.983029 23750 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:03.983201 23750 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 129 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:03.983481 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 129 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:03.983507 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 129 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:03.983997 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 129 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:03.984519 23750 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Leader election lost for term 129. Reason: could not achieve majority
I20260319 16:36:03.999989 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 128. Current term is 129. Ops: []
I20260319 16:36:04.000519 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 128.117, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260319 16:36:04.000707 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 LEADER]: Stepping down as leader of term 128
I20260319 16:36:04.000844 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:04.000928 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 128.117, Last appended by leader: 117, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.001024 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 128 FOLLOWER]: Advancing to term 129
I20260319 16:36:04.089466 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 128 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:04.089573 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 128 FOLLOWER]: Advancing to term 129
I20260319 16:36:04.090247 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.090408 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 129 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:04.090641 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 129 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:04.090643 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 129 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:04.090761 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 129: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:04.091408 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 129 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 129.
I20260319 16:36:04.091604 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 129 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:04.091691 23753 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 FOLLOWER]: Leader election won for term 129
I20260319 16:36:04.091804 23753 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:04.091856 23753 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 128.117, Last appended by leader: 117, Current term: 129, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.092401 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 128 to 129, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 129 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:04.094950 23750 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:04.095106 23750 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 129 FOLLOWER]: Advancing to term 130
I20260319 16:36:04.095739 23750 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.095877 23750 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 130 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:04.096125 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 130 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:04.096251 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 130 candidate_status { last_received { term: 128 index: 117 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:04.096325 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 129 FOLLOWER]: Advancing to term 130
I20260319 16:36:04.096995 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 130.
I20260319 16:36:04.097213 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 130 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:04.097322 23750 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 FOLLOWER]: Leader election won for term 130
I20260319 16:36:04.097447 23750 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:04.097500 23750 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 128.117, Last appended by leader: 117, Current term: 130, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.098101 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 129 to 130, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 130 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:04.115525 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:04.178278 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 129. Current term is 130. Ops: []
I20260319 16:36:04.178596 23753 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260319 16:36:04.178719 23753 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 130.118 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 117
I20260319 16:36:04.178752 23753 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 LEADER]: Stepping down as leader of term 129
I20260319 16:36:04.178781 23753 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:04.178845 23753 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 129.118, Last appended by leader: 118, Current term: 129, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.178905 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 129 FOLLOWER]: Advancing to term 130
I20260319 16:36:04.185680 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 130 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 129 index: 118. Preceding OpId from leader: term: 130 index: 118. (term mismatch)
I20260319 16:36:04.185853 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 117
I20260319 16:36:04.185876 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 129.118
I20260319 16:36:04.185895 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 130 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:04.186285 23750 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260319 16:36:04.188079 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 130 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 128 index: 117. Preceding OpId from leader: term: 130 index: 118. (index mismatch)
I20260319 16:36:04.188387 23750 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260319 16:36:04.382133 23754 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 130 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:04.382345 23754 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 130 FOLLOWER]: Advancing to term 131
I20260319 16:36:04.383229 23754 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.383433 23754 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 131 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:04.383742 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 131 candidate_status { last_received { term: 130 index: 118 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:04.383828 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 131 candidate_status { last_received { term: 130 index: 118 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:04.384152 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 131 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:04.384305 23754 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Leader election lost for term 131. Reason: could not achieve majority
I20260319 16:36:04.390869 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 130. Current term is 131. Ops: []
I20260319 16:36:04.391337 23757 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 130.118, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260319 16:36:04.391546 23757 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 LEADER]: Stepping down as leader of term 130
I20260319 16:36:04.391580 23757 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:04.391657 23757 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 130.118, Last appended by leader: 118, Current term: 130, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.391748 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 130 FOLLOWER]: Advancing to term 131
I20260319 16:36:04.404366 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 130 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:04.404471 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 130 FOLLOWER]: Advancing to term 131
I20260319 16:36:04.405236 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.405421 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 131 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:04.405671 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 131 candidate_status { last_received { term: 130 index: 118 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:04.405719 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 131 candidate_status { last_received { term: 130 index: 118 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:04.405902 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 131: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:04.406533 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 131.
I20260319 16:36:04.406843 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 131 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:04.407037 23753 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 FOLLOWER]: Leader election won for term 131
I20260319 16:36:04.407091 23753 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:04.407126 23753 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 130.118, Last appended by leader: 118, Current term: 131, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.407720 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 130 to 131, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 131 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:04.486155 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 131 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 130 index: 118. Preceding OpId from leader: term: 131 index: 119. (index mismatch)
I20260319 16:36:04.486502 23753 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260319 16:36:04.487766 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 130 index: 118. Preceding OpId from leader: term: 131 index: 119. (index mismatch)
I20260319 16:36:04.487952 23753 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260319 16:36:04.588649 23754 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:04.588759 23754 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 131 FOLLOWER]: Advancing to term 132
I20260319 16:36:04.589540 23754 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.589819 23754 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 132 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:04.589958 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 132 candidate_status { last_received { term: 131 index: 119 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:04.590026 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 132 candidate_status { last_received { term: 131 index: 119 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:04.590029 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 131 FOLLOWER]: Advancing to term 132
I20260319 16:36:04.590879 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 132.
I20260319 16:36:04.591078 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:04.591215 23754 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 FOLLOWER]: Leader election won for term 132
I20260319 16:36:04.591295 23754 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:04.591353 23754 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 131.119, Last appended by leader: 119, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.592082 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 131 to 132, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 132 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:04.604873 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 132 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 131. Current term is 132. Ops: []
I20260319 16:36:04.605257 23753 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 131.119, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260319 16:36:04.605381 23753 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 LEADER]: Stepping down as leader of term 131
I20260319 16:36:04.605408 23753 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:04.605474 23753 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 131.119, Last appended by leader: 119, Current term: 131, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.605551 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 131 FOLLOWER]: Advancing to term 132
I20260319 16:36:04.673032 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 132 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 131 index: 119. Preceding OpId from leader: term: 132 index: 120. (index mismatch)
I20260319 16:36:04.673435 23754 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260319 16:36:04.674587 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 132 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 131 index: 119. Preceding OpId from leader: term: 132 index: 120. (index mismatch)
I20260319 16:36:04.674820 23754 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260319 16:36:04.776036 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 132 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:04.776165 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 132 FOLLOWER]: Advancing to term 133
I20260319 16:36:04.777132 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.777410 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 132. Current term is 133. Ops: []
I20260319 16:36:04.777456 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 133 candidate_status { last_received { term: 132 index: 120 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:04.777542 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 132 FOLLOWER]: Advancing to term 133
I20260319 16:36:04.777575 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 133 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:04.777607 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 133 candidate_status { last_received { term: 132 index: 120 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:04.777767 23754 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 132.120, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260319 16:36:04.777845 23754 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 LEADER]: Stepping down as leader of term 132
I20260319 16:36:04.777868 23754 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:04.777918 23754 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 132.120, Last appended by leader: 120, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.777985 23754 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 132 FOLLOWER]: Advancing to term 133
I20260319 16:36:04.778424 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 133.
I20260319 16:36:04.778630 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:04.778748 23757 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 FOLLOWER]: Leader election won for term 133
I20260319 16:36:04.778795 23757 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:04.778837 23757 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 132.120, Last appended by leader: 120, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:04.779423 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 132 to 133, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 133 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:04.900408 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 133 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 132 index: 120. Preceding OpId from leader: term: 133 index: 121. (index mismatch)
I20260319 16:36:04.900408 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 133 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 132 index: 120. Preceding OpId from leader: term: 133 index: 121. (index mismatch)
I20260319 16:36:04.900776 23758 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260319 16:36:04.900924 23757 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260319 16:36:05.003593 23759 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 133 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:05.003759 23759 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 133 FOLLOWER]: Advancing to term 134
I20260319 16:36:05.004608 23759 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.004868 23759 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 134 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.005271 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 134 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.005370 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 134 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:05.005658 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 134 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:05.005793 23759 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Leader election lost for term 134. Reason: could not achieve majority
I20260319 16:36:05.013262 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 133. Current term is 134. Ops: []
I20260319 16:36:05.013681 23757 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 133.121, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260319 16:36:05.013859 23757 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 LEADER]: Stepping down as leader of term 133
I20260319 16:36:05.013906 23757 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:05.013963 23757 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 133.121, Last appended by leader: 121, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.014057 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 133 FOLLOWER]: Advancing to term 134
I20260319 16:36:05.101716 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 133 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:05.101840 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 133 FOLLOWER]: Advancing to term 134
I20260319 16:36:05.102648 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.102959 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 134 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.103152 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 134 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.103232 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 134: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:05.103267 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 134 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.104048 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 134.
I20260319 16:36:05.104249 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:05.104456 23753 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 FOLLOWER]: Leader election won for term 134
I20260319 16:36:05.104512 23753 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:05.104564 23753 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 133.121, Last appended by leader: 121, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.105394 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 133 to 134, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 134 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:05.115860 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:05.128293 23759 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:05.128405 23759 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 134 FOLLOWER]: Advancing to term 135
I20260319 16:36:05.129201 23759 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.129357 23759 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 135 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.129581 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 135 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:05.129617 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 135 candidate_status { last_received { term: 133 index: 121 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.129812 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 134 FOLLOWER]: Advancing to term 135
I20260319 16:36:05.130434 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 135 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 135.
I20260319 16:36:05.130695 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 135 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:05.130805 23759 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 FOLLOWER]: Leader election won for term 135
I20260319 16:36:05.130864 23759 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:05.130913 23759 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 133.121, Last appended by leader: 121, Current term: 135, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.131486 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 134 to 135, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 135 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:05.217111 23426 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 LEADER]: Stepping down as leader of term 134
I20260319 16:36:05.217207 23426 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:05.217264 23426 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 134.122, Last appended by leader: 122, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.217363 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 134 FOLLOWER]: Advancing to term 135
I20260319 16:36:05.218179 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 135 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 134 index: 122. Preceding OpId from leader: term: 135 index: 122. (term mismatch)
I20260319 16:36:05.218235 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 121
I20260319 16:36:05.218246 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 134.122
I20260319 16:36:05.218258 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 135 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:05.218539 23759 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260319 16:36:05.220413 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 135 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 133 index: 121. Preceding OpId from leader: term: 135 index: 122. (index mismatch)
I20260319 16:36:05.220731 23759 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260319 16:36:05.402252 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 135 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:05.402382 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 135 FOLLOWER]: Advancing to term 136
I20260319 16:36:05.403194 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.403374 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 136 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:05.403623 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 136 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:05.403671 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 136 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.404012 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 136 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:05.404172 23757 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Leader election lost for term 136. Reason: could not achieve majority
I20260319 16:36:05.405958 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 135. Current term is 136. Ops: []
I20260319 16:36:05.406319 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 135.122, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260319 16:36:05.406443 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 LEADER]: Stepping down as leader of term 135
I20260319 16:36:05.406461 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:05.406513 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 135.122, Last appended by leader: 122, Current term: 135, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.406601 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 135 FOLLOWER]: Advancing to term 136
I20260319 16:36:05.443159 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 135 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:05.443290 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 135 FOLLOWER]: Advancing to term 136
I20260319 16:36:05.444063 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.444370 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 136 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.444495 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 136 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.444501 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 136 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.444621 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 136: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:05.445444 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 136.
I20260319 16:36:05.445755 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:05.445924 23753 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 FOLLOWER]: Leader election won for term 136
I20260319 16:36:05.445981 23753 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:05.446031 23753 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 135.122, Last appended by leader: 122, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.446564 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 135 to 136, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 136 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:05.511642 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:05.511765 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 136 FOLLOWER]: Advancing to term 137
I20260319 16:36:05.512518 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.512667 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 137 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:05.512909 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 137 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:05.512919 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 137 candidate_status { last_received { term: 135 index: 122 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.513021 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 136 FOLLOWER]: Advancing to term 137
I20260319 16:36:05.513612 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 137 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 137.
I20260319 16:36:05.513913 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 137 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:05.514032 23757 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 FOLLOWER]: Leader election won for term 137
I20260319 16:36:05.514134 23757 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:05.514206 23757 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 135.122, Last appended by leader: 122, Current term: 137, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.514849 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 136 to 137, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 137 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:05.542526 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 136. Current term is 137. Ops: []
I20260319 16:36:05.542853 23753 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260319 16:36:05.542971 23753 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 137.123 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 122
I20260319 16:36:05.543109 23756 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 LEADER]: Stepping down as leader of term 136
I20260319 16:36:05.543159 23756 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:05.543236 23756 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 136.123, Last appended by leader: 123, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.543326 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 136 FOLLOWER]: Advancing to term 137
I20260319 16:36:05.616830 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 137 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 135 index: 122. Preceding OpId from leader: term: 137 index: 123. (index mismatch)
I20260319 16:36:05.617251 23757 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260319 16:36:05.618664 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 137 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 136 index: 123. Preceding OpId from leader: term: 137 index: 123. (term mismatch)
I20260319 16:36:05.618728 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 122
I20260319 16:36:05.618746 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 136.123
I20260319 16:36:05.618762 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 137 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:05.618985 23757 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260319 16:36:05.822115 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 137 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:05.822227 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 137 FOLLOWER]: Advancing to term 138
I20260319 16:36:05.822978 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.823154 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 138 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.823397 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 138 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.823411 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 138 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.823812 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 138 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:05.823972 23753 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Leader election lost for term 138. Reason: could not achieve majority
I20260319 16:36:05.829399 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 137. Current term is 138. Ops: []
I20260319 16:36:05.829730 23757 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 137.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260319 16:36:05.829875 23757 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 LEADER]: Stepping down as leader of term 137
I20260319 16:36:05.829911 23757 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:05.829979 23757 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 137.123, Last appended by leader: 123, Current term: 137, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.830104 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 137 FOLLOWER]: Advancing to term 138
I20260319 16:36:05.889652 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 137 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:05.889772 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 137 FOLLOWER]: Advancing to term 138
I20260319 16:36:05.890585 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.890784 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 138 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.891047 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 138 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:05.891047 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 138 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.891144 23426 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 138: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:05.892125 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 138.
I20260319 16:36:05.892403 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:05.892556 23755 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 FOLLOWER]: Leader election won for term 138
I20260319 16:36:05.892632 23755 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:05.892686 23755 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 137.123, Last appended by leader: 123, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.893278 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 137 to 138, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 138 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:05.969514 23753 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:05.969619 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 138 FOLLOWER]: Advancing to term 139
I20260319 16:36:05.970326 23753 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.970494 23753 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 139 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:05.970738 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 139 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:05.970803 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 138 FOLLOWER]: Advancing to term 139
I20260319 16:36:05.970853 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 139 candidate_status { last_received { term: 137 index: 123 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:05.971410 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 139 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 139.
I20260319 16:36:05.971609 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 139 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:05.971701 23753 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 FOLLOWER]: Leader election won for term 139
I20260319 16:36:05.971750 23753 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:05.971794 23753 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 137.123, Last appended by leader: 123, Current term: 139, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.972630 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 138 to 139, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 139 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:05.993193 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 138. Current term is 139. Ops: []
I20260319 16:36:05.993346 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 139 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 138. Current term is 139. Ops: []
I20260319 16:36:05.993499 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260319 16:36:05.993676 23755 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 139.124 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 123
I20260319 16:36:05.993732 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 LEADER]: Stepping down as leader of term 138
I20260319 16:36:05.993759 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:05.993810 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 138.124, Last appended by leader: 124, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:05.993968 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 138 FOLLOWER]: Advancing to term 139
W20260319 16:36:05.993896 23759 consensus_queue.cc:1175] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "df6bf03d752948d8a51e1ac8ac806839" responder_term: 139 status { last_received { term: 137 index: 123 } last_committed_idx: 123 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 138. Current term is 139. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260319 16:36:06.052438 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 139 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 137 index: 123. Preceding OpId from leader: term: 139 index: 124. (index mismatch)
I20260319 16:36:06.052749 23753 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260319 16:36:06.054215 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 139 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 138 index: 124. Preceding OpId from leader: term: 139 index: 124. (term mismatch)
I20260319 16:36:06.054282 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 123
I20260319 16:36:06.054301 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 138.124
I20260319 16:36:06.054317 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 139 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:06.054458 23763 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260319 16:36:06.116278 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:06.242833 23759 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 139 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:06.242937 23759 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 139 FOLLOWER]: Advancing to term 140
I20260319 16:36:06.243647 23759 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.243929 23759 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 140 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:06.244032 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 140 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:06.244097 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 140 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:06.244310 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 140 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:06.244405 23759 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Leader election lost for term 140. Reason: could not achieve majority
I20260319 16:36:06.262166 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 139. Current term is 140. Ops: []
I20260319 16:36:06.262413 23756 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 139.124, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260319 16:36:06.262542 23753 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 LEADER]: Stepping down as leader of term 139
I20260319 16:36:06.262583 23753 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:06.262637 23753 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 139.124, Last appended by leader: 124, Current term: 139, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.262696 23753 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 139 FOLLOWER]: Advancing to term 140
I20260319 16:36:06.328090 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 139 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:06.328207 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 139 FOLLOWER]: Advancing to term 140
I20260319 16:36:06.329079 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.329234 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 140 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:06.329496 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 140 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:06.329535 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 140 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:06.329698 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 140: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:06.330304 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 140.
I20260319 16:36:06.330489 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:06.330590 23757 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 FOLLOWER]: Leader election won for term 140
I20260319 16:36:06.330705 23757 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:06.330767 23757 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 139.124, Last appended by leader: 124, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.331419 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 139 to 140, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 140 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:06.355966 23759 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:06.356081 23759 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 140 FOLLOWER]: Advancing to term 141
I20260319 16:36:06.356806 23759 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.357110 23759 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 141 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:06.357221 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 141 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:06.357220 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 141 candidate_status { last_received { term: 139 index: 124 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:06.357316 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 140 FOLLOWER]: Advancing to term 141
I20260319 16:36:06.357872 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 141.
I20260319 16:36:06.358095 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:06.358230 23759 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 FOLLOWER]: Leader election won for term 141
I20260319 16:36:06.358304 23759 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:06.358352 23759 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 139.124, Last appended by leader: 124, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.358922 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 140 to 141, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 141 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:06.445825 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 141 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 140. Current term is 141. Ops: []
I20260319 16:36:06.446170 23757 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260319 16:36:06.446447 23757 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 LEADER]: Stepping down as leader of term 140
I20260319 16:36:06.446480 23757 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:06.446537 23757 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 140.125, Last appended by leader: 125, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.446607 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 140 FOLLOWER]: Advancing to term 141
I20260319 16:36:06.447583 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 141 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 140 index: 125. Preceding OpId from leader: term: 141 index: 125. (term mismatch)
I20260319 16:36:06.447649 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 124
I20260319 16:36:06.447672 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 140.125
I20260319 16:36:06.447690 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 141 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:06.448184 23759 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260319 16:36:06.449611 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 141 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 139 index: 124. Preceding OpId from leader: term: 141 index: 125. (index mismatch)
I20260319 16:36:06.449846 23762 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260319 16:36:06.791981 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 141 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:06.792091 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 141 FOLLOWER]: Advancing to term 142
I20260319 16:36:06.792907 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.793063 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 142 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:06.793337 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 142 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:06.793386 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 142 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:06.793561 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 142 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:06.793656 23757 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Leader election lost for term 142. Reason: could not achieve majority
I20260319 16:36:06.795109 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 141. Current term is 142. Ops: []
I20260319 16:36:06.795378 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 141.125, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260319 16:36:06.795501 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 LEADER]: Stepping down as leader of term 141
I20260319 16:36:06.795531 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:06.795588 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 141.125, Last appended by leader: 125, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.795674 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 141 FOLLOWER]: Advancing to term 142
I20260319 16:36:06.814123 23756 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 141 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:06.814232 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 141 FOLLOWER]: Advancing to term 142
I20260319 16:36:06.815053 23756 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.815238 23756 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 142 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:06.815541 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 142 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:06.815548 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 142 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:06.815670 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 142: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:06.816350 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 142 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 142.
I20260319 16:36:06.816601 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 142 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:06.816838 23756 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 FOLLOWER]: Leader election won for term 142
I20260319 16:36:06.816913 23756 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:06.816977 23756 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 141.125, Last appended by leader: 125, Current term: 142, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.817481 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 141 to 142, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 142 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:06.897163 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:06.897291 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 142 FOLLOWER]: Advancing to term 143
I20260319 16:36:06.898324 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.898483 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 143 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:06.898852 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 143 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:06.898803 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 143 candidate_status { last_received { term: 141 index: 125 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:06.899060 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 142 FOLLOWER]: Advancing to term 143
I20260319 16:36:06.899710 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 143.
I20260319 16:36:06.900056 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:06.900173 23757 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 FOLLOWER]: Leader election won for term 143
I20260319 16:36:06.900230 23757 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:06.900305 23757 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 141.125, Last appended by leader: 125, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.900897 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 142 to 143, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 143 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:06.913076 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 142. Current term is 143. Ops: []
I20260319 16:36:06.913096 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 143 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 142. Current term is 143. Ops: []
I20260319 16:36:06.913447 23756 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260319 16:36:06.913646 23756 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 143.126 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 125
I20260319 16:36:06.913697 23765 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 LEADER]: Stepping down as leader of term 142
I20260319 16:36:06.913728 23765 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:06.913857 23753 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260319 16:36:06.914000 23765 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 142.126, Last appended by leader: 126, Current term: 142, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:06.914163 23765 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 142 FOLLOWER]: Advancing to term 143
I20260319 16:36:06.992475 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 143 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 141 index: 125. Preceding OpId from leader: term: 143 index: 126. (index mismatch)
I20260319 16:36:06.992903 23757 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260319 16:36:06.994375 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 143 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 142 index: 126. Preceding OpId from leader: term: 143 index: 126. (term mismatch)
I20260319 16:36:06.994439 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 125
I20260319 16:36:06.994457 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 142.126
I20260319 16:36:06.994474 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 143 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:06.994663 23766 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260319 16:36:07.094707 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 143 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:07.094895 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 143 FOLLOWER]: Advancing to term 144
I20260319 16:36:07.095760 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.096165 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 144 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.096248 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.096593 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:07.096637 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 143. Current term is 144. Ops: []
I20260319 16:36:07.097018 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 144 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:07.097133 23755 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Leader election lost for term 144. Reason: could not achieve majority
I20260319 16:36:07.097133 23757 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 143.126, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260319 16:36:07.097301 23757 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 LEADER]: Stepping down as leader of term 143
I20260319 16:36:07.097334 23757 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:07.097389 23757 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 143.126, Last appended by leader: 126, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.097460 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 143 FOLLOWER]: Advancing to term 144
I20260319 16:36:07.116619 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:07.188604 23756 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 143 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:07.188725 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 143 FOLLOWER]: Advancing to term 144
I20260319 16:36:07.189607 23756 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.189817 23756 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 144 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.190090 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:07.190163 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 144 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.190165 23579 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 144: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:07.191082 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 144 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 144.
I20260319 16:36:07.191282 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 144 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:07.191397 23756 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 FOLLOWER]: Leader election won for term 144
I20260319 16:36:07.191474 23756 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:07.191524 23756 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 143.126, Last appended by leader: 126, Current term: 144, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.192092 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 143 to 144, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 144 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:07.242561 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:07.242667 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 144 FOLLOWER]: Advancing to term 145
I20260319 16:36:07.243422 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.243585 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 145 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.243818 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 145 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:07.243822 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 145 candidate_status { last_received { term: 143 index: 126 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.244064 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 144 FOLLOWER]: Advancing to term 145
I20260319 16:36:07.244714 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 145 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 145.
I20260319 16:36:07.244915 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 145 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:07.245013 23755 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 FOLLOWER]: Leader election won for term 145
I20260319 16:36:07.245183 23755 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:07.245240 23755 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 143.126, Last appended by leader: 126, Current term: 145, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.245968 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 144 to 145, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 145 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:07.271911 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 145 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 144. Current term is 145. Ops: []
I20260319 16:36:07.272230 23756 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260319 16:36:07.272354 23756 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 LEADER]: Stepping down as leader of term 144
I20260319 16:36:07.272387 23756 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:07.272437 23756 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 144.127, Last appended by leader: 127, Current term: 144, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.272509 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 144 FOLLOWER]: Advancing to term 145
I20260319 16:36:07.366411 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 145 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 143 index: 126. Preceding OpId from leader: term: 145 index: 127. (index mismatch)
I20260319 16:36:07.366715 23755 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260319 16:36:07.367976 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 145 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 144 index: 127. Preceding OpId from leader: term: 145 index: 127. (term mismatch)
I20260319 16:36:07.368049 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 126
I20260319 16:36:07.368068 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 144.127
I20260319 16:36:07.368085 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 145 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:07.368310 23755 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260319 16:36:07.468842 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 145 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:07.468940 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 145 FOLLOWER]: Advancing to term 146
I20260319 16:36:07.469614 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.469775 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 146 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:07.470057 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 146 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:07.470121 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 146 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:07.470309 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 146 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:07.470403 23757 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Leader election lost for term 146. Reason: could not achieve majority
I20260319 16:36:07.477734 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 145. Current term is 146. Ops: []
I20260319 16:36:07.478137 23762 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 145.127, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260319 16:36:07.478286 23762 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 LEADER]: Stepping down as leader of term 145
I20260319 16:36:07.478324 23762 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:07.478399 23762 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 145.127, Last appended by leader: 127, Current term: 145, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.478478 23762 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 145 FOLLOWER]: Advancing to term 146
I20260319 16:36:07.564309 23765 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 145 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:07.564424 23765 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 145 FOLLOWER]: Advancing to term 146
I20260319 16:36:07.565315 23765 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.565510 23765 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 146 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.565742 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 146 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:07.565745 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 146 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.566031 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 146: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:07.566530 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 146.
I20260319 16:36:07.566804 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:07.566944 23765 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 FOLLOWER]: Leader election won for term 146
I20260319 16:36:07.567023 23765 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:07.567080 23765 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 145.127, Last appended by leader: 127, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.567633 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 145 to 146, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 146 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:07.601883 23757 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:07.601995 23757 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 146 FOLLOWER]: Advancing to term 147
I20260319 16:36:07.602859 23757 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.603152 23757 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 147 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:07.603251 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 147 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:07.603320 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 147 candidate_status { last_received { term: 145 index: 127 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:07.603382 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 146 FOLLOWER]: Advancing to term 147
I20260319 16:36:07.604050 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 147 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 147.
I20260319 16:36:07.604278 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 147 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:07.604368 23757 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 FOLLOWER]: Leader election won for term 147
I20260319 16:36:07.604467 23757 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:07.604516 23757 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 145.127, Last appended by leader: 127, Current term: 147, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.605155 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 146 to 147, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 147 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:07.655133 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 147 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 146. Current term is 147. Ops: []
I20260319 16:36:07.655488 23765 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260319 16:36:07.655627 23765 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 LEADER]: Stepping down as leader of term 146
I20260319 16:36:07.655654 23765 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:07.655750 23765 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 146.128, Last appended by leader: 128, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.655833 23765 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 146 FOLLOWER]: Advancing to term 147
I20260319 16:36:07.715752 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 147 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 146 index: 128. Preceding OpId from leader: term: 147 index: 128. (term mismatch)
I20260319 16:36:07.715859 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 127
I20260319 16:36:07.715878 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 146.128
I20260319 16:36:07.715895 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 147 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:07.716234 23757 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260319 16:36:07.717016 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 147 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 145 index: 127. Preceding OpId from leader: term: 147 index: 128. (index mismatch)
I20260319 16:36:07.717272 23767 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260319 16:36:07.940179 23765 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 147 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:07.940312 23765 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 147 FOLLOWER]: Advancing to term 148
I20260319 16:36:07.941164 23765 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.941381 23765 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 148 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.941663 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 148 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.941690 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 148 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:07.941962 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 148 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:07.942111 23765 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Leader election lost for term 148. Reason: could not achieve majority
I20260319 16:36:07.949450 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 147. Current term is 148. Ops: []
I20260319 16:36:07.950150 23768 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 147.128, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260319 16:36:07.950348 23769 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 LEADER]: Stepping down as leader of term 147
I20260319 16:36:07.950416 23769 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:07.950501 23769 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 147.128, Last appended by leader: 128, Current term: 147, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.950603 23769 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 147 FOLLOWER]: Advancing to term 148
I20260319 16:36:07.990700 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 147 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:07.990818 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 147 FOLLOWER]: Advancing to term 148
I20260319 16:36:07.991559 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.991855 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 148 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:07.991986 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 148 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:07.991998 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 148 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:07.992179 23426 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 148: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:07.993026 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 148 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 148.
I20260319 16:36:07.993347 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 148 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:07.993501 23755 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 FOLLOWER]: Leader election won for term 148
I20260319 16:36:07.993578 23755 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:07.993633 23755 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 147.128, Last appended by leader: 128, Current term: 148, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:07.994551 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 147 to 148, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 148 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:08.086697 23765 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:08.086827 23765 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 148 FOLLOWER]: Advancing to term 149
I20260319 16:36:08.087549 23765 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.087733 23765 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 149 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:08.087945 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 149 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:08.088097 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 149 candidate_status { last_received { term: 147 index: 128 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:08.088187 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 148 FOLLOWER]: Advancing to term 149
I20260319 16:36:08.089166 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 149.
I20260319 16:36:08.089468 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:08.089607 23765 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 FOLLOWER]: Leader election won for term 149
I20260319 16:36:08.089681 23765 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:08.089740 23765 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 147.128, Last appended by leader: 128, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.090309 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 148 to 149, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 149 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:08.095853 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 LEADER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 148. Current term is 149. Ops: []
I20260319 16:36:08.096192 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260319 16:36:08.096336 23755 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 149.129 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 128
I20260319 16:36:08.096371 23762 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 LEADER]: Stepping down as leader of term 148
I20260319 16:36:08.096410 23762 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:08.096464 23762 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 148.129, Last appended by leader: 129, Current term: 148, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.096545 23762 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 148 FOLLOWER]: Advancing to term 149
I20260319 16:36:08.117026 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:08.182099 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 149 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 148 index: 129. Preceding OpId from leader: term: 149 index: 129. (term mismatch)
I20260319 16:36:08.182195 23579 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting all ops after (but not including) 128
I20260319 16:36:08.182215 23579 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: Aborting uncommitted NO_OP operation due to leader change: 148.129
I20260319 16:36:08.182233 23579 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 149 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:08.182571 23765 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260319 16:36:08.184067 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 149 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 147 index: 128. Preceding OpId from leader: term: 149 index: 129. (index mismatch)
I20260319 16:36:08.184338 23770 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260319 16:36:08.285632 23768 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 149 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:08.285773 23768 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 149 FOLLOWER]: Advancing to term 150
I20260319 16:36:08.287093 23768 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.287360 23768 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 150 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:08.287760 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 150 candidate_status { last_received { term: 149 index: 129 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:08.287859 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 150 candidate_status { last_received { term: 149 index: 129 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:08.287864 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 149 FOLLOWER]: Advancing to term 150
I20260319 16:36:08.288828 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 150 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 150.
I20260319 16:36:08.289114 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 150 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:08.289625 23768 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 FOLLOWER]: Leader election won for term 150
I20260319 16:36:08.289705 23768 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:08.289774 23768 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 149.129, Last appended by leader: 129, Current term: 150, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.290338 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 149 to 150, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 150 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:08.291188 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 LEADER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 149. Current term is 150. Ops: []
I20260319 16:36:08.291406 23770 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 149.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260319 16:36:08.291503 23770 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer df6bf03d752948d8a51e1ac8ac806839 log is divergent from this leader: its last log entry 150.130 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 129
I20260319 16:36:08.291534 23756 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 LEADER]: Stepping down as leader of term 149
I20260319 16:36:08.291572 23756 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:08.291627 23756 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 149.129, Last appended by leader: 129, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.291700 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 149 FOLLOWER]: Advancing to term 150
I20260319 16:36:08.386930 23579 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 150 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 149 index: 129. Preceding OpId from leader: term: 150 index: 130. (index mismatch)
I20260319 16:36:08.387389 23768 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260319 16:36:08.388689 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 150 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 149 index: 129. Preceding OpId from leader: term: 150 index: 130. (index mismatch)
I20260319 16:36:08.389169 23768 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260319 16:36:08.489681 23762 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 150 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:08.489878 23762 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 150 FOLLOWER]: Advancing to term 151
I20260319 16:36:08.490635 23762 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.490818 23762 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 151 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:08.491114 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 151 candidate_status { last_received { term: 150 index: 130 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:08.491114 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 151 candidate_status { last_received { term: 150 index: 130 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:08.491230 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 150 FOLLOWER]: Advancing to term 151
I20260319 16:36:08.491875 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 151 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 151.
I20260319 16:36:08.492206 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 151 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:08.492343 23762 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 FOLLOWER]: Leader election won for term 151
I20260319 16:36:08.492389 23762 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:08.492429 23762 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 150.130, Last appended by leader: 130, Current term: 151, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.492983 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 150 to 151, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 151 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:08.499197 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 151 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 150. Current term is 151. Ops: []
I20260319 16:36:08.499528 23771 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 150.130, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260319 16:36:08.499663 23771 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 LEADER]: Stepping down as leader of term 150
I20260319 16:36:08.499684 23771 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:08.499747 23771 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 150.130, Last appended by leader: 130, Current term: 150, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.499918 23771 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 150 FOLLOWER]: Advancing to term 151
I20260319 16:36:08.571549 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 151 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 150 index: 130. Preceding OpId from leader: term: 151 index: 131. (index mismatch)
I20260319 16:36:08.571913 23762 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260319 16:36:08.573119 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 151 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 150 index: 130. Preceding OpId from leader: term: 151 index: 131. (index mismatch)
I20260319 16:36:08.573441 23772 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260319 16:36:08.753602 23770 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 151 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:08.753703 23770 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 151 FOLLOWER]: Advancing to term 152
I20260319 16:36:08.754667 23770 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.754937 23770 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 152 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:08.755149 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 152 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:08.755146 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 152 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:08.755491 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 152 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:08.755633 23770 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Leader election lost for term 152. Reason: could not achieve majority
I20260319 16:36:08.774596 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 151. Current term is 152. Ops: []
I20260319 16:36:08.775362 23762 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 151.131, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260319 16:36:08.775660 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 LEADER]: Stepping down as leader of term 151
I20260319 16:36:08.775831 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:08.775908 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 151.131, Last appended by leader: 131, Current term: 151, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.776005 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 151 FOLLOWER]: Advancing to term 152
I20260319 16:36:08.854745 23771 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 151 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:08.854871 23771 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 151 FOLLOWER]: Advancing to term 152
I20260319 16:36:08.855770 23771 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.855957 23771 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 152 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:08.856186 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 152 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:08.856287 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 152 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:08.856317 23426 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 152: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:08.857254 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 152.
I20260319 16:36:08.857501 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:08.857661 23771 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 FOLLOWER]: Leader election won for term 152
I20260319 16:36:08.857738 23771 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:08.857836 23771 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 151.131, Last appended by leader: 131, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.859179 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 151 to 152, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 152 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:08.880966 23770 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:08.881165 23770 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 152 FOLLOWER]: Advancing to term 153
I20260319 16:36:08.882284 23770 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.882738 23770 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 153 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:08.882853 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 153 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:08.882853 23579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 153 candidate_status { last_received { term: 151 index: 131 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:08.883256 23579 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 152 FOLLOWER]: Advancing to term 153
I20260319 16:36:08.884092 23579 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 153 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 153.
I20260319 16:36:08.884407 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 153 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:08.884506 23770 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 FOLLOWER]: Leader election won for term 153
I20260319 16:36:08.884554 23770 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:08.884604 23770 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 151.131, Last appended by leader: 131, Current term: 153, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.885171 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 152 to 153, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 153 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:08.960825 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 152. Current term is 153. Ops: []
I20260319 16:36:08.960855 23579 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 153 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 152. Current term is 153. Ops: []
I20260319 16:36:08.961054 23578 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 153 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 151 index: 131. Preceding OpId from leader: term: 153 index: 132. (index mismatch)
I20260319 16:36:08.961231 23770 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260319 16:36:08.961226 23768 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260319 16:36:08.961519 23768 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 153.132 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 131
I20260319 16:36:08.961557 23769 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 LEADER]: Stepping down as leader of term 152
I20260319 16:36:08.961575 23771 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260319 16:36:08.961617 23769 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:08.961678 23769 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 152.132, Last appended by leader: 132, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:08.961778 23769 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 152 FOLLOWER]: Advancing to term 153
I20260319 16:36:08.962893 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 153 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 152 index: 132. Preceding OpId from leader: term: 153 index: 132. (term mismatch)
I20260319 16:36:08.963004 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 131
I20260319 16:36:08.963047 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 152.132
I20260319 16:36:08.963068 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 153 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:08.963500 23770 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260319 16:36:09.063271 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 153 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:09.063390 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 153 FOLLOWER]: Advancing to term 154
I20260319 16:36:09.064210 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.064422 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 154 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:09.064754 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 154 candidate_status { last_received { term: 153 index: 132 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:09.064767 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 154 candidate_status { last_received { term: 153 index: 132 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:09.065063 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 153 FOLLOWER]: Advancing to term 154
I20260319 16:36:09.065728 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 154.
I20260319 16:36:09.066025 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:09.066126 23755 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 FOLLOWER]: Leader election won for term 154
I20260319 16:36:09.066180 23755 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:09.066290 23755 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 153.132, Last appended by leader: 132, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.066900 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 153 to 154, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 154 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:09.083861 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 154 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 153. Current term is 154. Ops: []
I20260319 16:36:09.084398 23770 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 153.132, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260319 16:36:09.084546 23770 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 LEADER]: Stepping down as leader of term 153
I20260319 16:36:09.084581 23770 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:09.084641 23770 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 132, Committed index: 132, Last appended: 153.132, Last appended by leader: 132, Current term: 153, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.084724 23770 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 153 FOLLOWER]: Advancing to term 154
I20260319 16:36:09.117318 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:09.181480 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 154 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 153 index: 132. Preceding OpId from leader: term: 154 index: 133. (index mismatch)
I20260319 16:36:09.181835 23755 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260319 16:36:09.183005 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 154 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 153 index: 132. Preceding OpId from leader: term: 154 index: 133. (index mismatch)
I20260319 16:36:09.183192 23762 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 133, Last known committed idx: 132, Time since last communication: 0.000s
I20260319 16:36:09.283815 23769 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 154 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:09.283924 23769 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 154 FOLLOWER]: Advancing to term 155
I20260319 16:36:09.284725 23769 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.284881 23769 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 155 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:09.285128 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:09.285166 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 155 candidate_status { last_received { term: 154 index: 133 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:09.285213 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 154 FOLLOWER]: Advancing to term 155
I20260319 16:36:09.285890 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 155 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 155.
I20260319 16:36:09.286156 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 155 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:09.286278 23769 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 FOLLOWER]: Leader election won for term 155
I20260319 16:36:09.286335 23769 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:09.286387 23769 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 154.133, Last appended by leader: 133, Current term: 155, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.286904 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 154 to 155, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 155 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:09.289710 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 155 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 154. Current term is 155. Ops: []
I20260319 16:36:09.289985 23755 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 154.133, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260319 16:36:09.290105 23755 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 LEADER]: Stepping down as leader of term 154
I20260319 16:36:09.290131 23755 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:09.290184 23755 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 133, Committed index: 133, Last appended: 154.133, Last appended by leader: 133, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.290257 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 154 FOLLOWER]: Advancing to term 155
I20260319 16:36:09.380604 23578 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 155 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 154 index: 133. Preceding OpId from leader: term: 155 index: 134. (index mismatch)
I20260319 16:36:09.381059 23769 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260319 16:36:09.382205 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 155 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 154 index: 133. Preceding OpId from leader: term: 155 index: 134. (index mismatch)
I20260319 16:36:09.382377 23771 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 134, Last known committed idx: 133, Time since last communication: 0.000s
I20260319 16:36:09.483386 23756 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 155 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:09.483501 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 155 FOLLOWER]: Advancing to term 156
I20260319 16:36:09.484404 23756 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.484582 23756 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 156 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:09.484812 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 156 candidate_status { last_received { term: 155 index: 134 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:09.484825 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 156 candidate_status { last_received { term: 155 index: 134 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:09.484921 23578 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 155 FOLLOWER]: Advancing to term 156
I20260319 16:36:09.486069 23578 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 156 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 156.
I20260319 16:36:09.486322 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 156 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:09.486418 23756 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 FOLLOWER]: Leader election won for term 156
I20260319 16:36:09.486493 23756 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:09.486547 23756 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 155.134, Last appended by leader: 134, Current term: 156, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.487074 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 155 to 156, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 156 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:09.493381 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 155. Current term is 156. Ops: []
I20260319 16:36:09.493680 23768 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 155.134, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260319 16:36:09.493799 23768 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer 789b0cf57b7649c7b025aebb211c3b29 log is divergent from this leader: its last log entry 156.135 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 134
I20260319 16:36:09.493837 23769 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 LEADER]: Stepping down as leader of term 155
I20260319 16:36:09.493891 23769 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:09.493963 23769 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 134, Committed index: 134, Last appended: 155.134, Last appended by leader: 134, Current term: 155, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.494050 23769 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 155 FOLLOWER]: Advancing to term 156
I20260319 16:36:09.590366 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 156 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 155 index: 134. Preceding OpId from leader: term: 156 index: 135. (index mismatch)
I20260319 16:36:09.590680 23756 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260319 16:36:09.592077 23578 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 156 FOLLOWER]: Refusing update from remote peer 789b0cf57b7649c7b025aebb211c3b29: Log matching property violated. Preceding OpId in replica: term: 155 index: 134. Preceding OpId from leader: term: 156 index: 135. (index mismatch)
I20260319 16:36:09.592412 23756 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 135, Last known committed idx: 134, Time since last communication: 0.000s
I20260319 16:36:09.693384 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 156 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:09.693499 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 156 FOLLOWER]: Advancing to term 157
I20260319 16:36:09.694260 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.694510 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 157 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:09.694718 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 157 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:09.694737 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 157 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:09.695039 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 157 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:09.695138 23755 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Leader election lost for term 157. Reason: could not achieve majority
I20260319 16:36:09.702283 23578 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 156. Current term is 157. Ops: []
I20260319 16:36:09.702589 23770 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 156.135, Next index: 136, Last known committed idx: 135, Time since last communication: 0.000s
I20260319 16:36:09.702849 23756 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 LEADER]: Stepping down as leader of term 156
I20260319 16:36:09.702905 23756 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:09.702966 23756 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 135, Committed index: 135, Last appended: 156.135, Last appended by leader: 135, Current term: 156, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.703058 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 156 FOLLOWER]: Advancing to term 157
I20260319 16:36:09.789861 23769 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 156 FOLLOWER]: Starting leader election (detected failure of leader 789b0cf57b7649c7b025aebb211c3b29)
I20260319 16:36:09.789974 23769 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 156 FOLLOWER]: Advancing to term 157
I20260319 16:36:09.790819 23769 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.791121 23769 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 157 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:09.791451 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 157 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:09.791487 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 157 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:09.791594 23578 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 157: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:09.792106 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 157.
I20260319 16:36:09.792341 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 157 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:09.792506 23769 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 FOLLOWER]: Leader election won for term 157
I20260319 16:36:09.792586 23769 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:09.792642 23769 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 135, Committed index: 135, Last appended: 156.135, Last appended by leader: 135, Current term: 157, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.793386 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 156 to 157, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 157 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:09.837597 23755 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:09.837707 23755 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 157 FOLLOWER]: Advancing to term 158
I20260319 16:36:09.838582 23755 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.838965 23755 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 158 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:09.839193 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 158 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:09.839284 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 158 candidate_status { last_received { term: 156 index: 135 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:09.839339 23426 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 157 FOLLOWER]: Advancing to term 158
I20260319 16:36:09.839936 23426 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 158 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 158.
I20260319 16:36:09.840152 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 158 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:09.840297 23755 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 FOLLOWER]: Leader election won for term 158
I20260319 16:36:09.840437 23755 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:09.840492 23755 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 135, Committed index: 135, Last appended: 156.135, Last appended by leader: 135, Current term: 158, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.841009 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 157 to 158, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 158 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:09.871752 23578 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 LEADER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 157. Current term is 158. Ops: []
I20260319 16:36:09.872061 23769 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 136, Last known committed idx: 135, Time since last communication: 0.000s
I20260319 16:36:09.872172 23769 consensus_queue.cc:1243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer e60dc0e4f70541ecac7ceaa207d1eb0b log is divergent from this leader: its last log entry 158.136 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 135
I20260319 16:36:09.872205 23768 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 LEADER]: Stepping down as leader of term 157
I20260319 16:36:09.872244 23768 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:09.872340 23768 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 135, Committed index: 135, Last appended: 157.136, Last appended by leader: 136, Current term: 157, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:09.872418 23768 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 157 FOLLOWER]: Advancing to term 158
I20260319 16:36:09.948573 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 158 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 157 index: 136. Preceding OpId from leader: term: 158 index: 136. (term mismatch)
I20260319 16:36:09.948655 23502 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting all ops after (but not including) 135
I20260319 16:36:09.948668 23502 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: Aborting uncommitted NO_OP operation due to leader change: 157.136
I20260319 16:36:09.948680 23502 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 158 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:09.948923 23755 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 136, Last known committed idx: 135, Time since last communication: 0.000s
I20260319 16:36:09.950325 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 158 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 156 index: 135. Preceding OpId from leader: term: 158 index: 136. (index mismatch)
I20260319 16:36:09.950526 23775 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 136, Last known committed idx: 135, Time since last communication: 0.000s
I20260319 16:36:10.117619 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:10.128497 23756 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 158 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:10.128607 23756 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 158 FOLLOWER]: Advancing to term 159
I20260319 16:36:10.129422 23756 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.129765 23756 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 159 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:10.130016 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 159 candidate_status { last_received { term: 158 index: 136 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.130016 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 159 candidate_status { last_received { term: 158 index: 136 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:10.130276 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:10.130379 23756 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260319 16:36:10.139405 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 158. Current term is 159. Ops: []
I20260319 16:36:10.139793 23774 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 158.136, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20260319 16:36:10.140004 23774 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 LEADER]: Stepping down as leader of term 158
I20260319 16:36:10.140038 23774 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:10.140122 23774 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 136, Committed index: 136, Last appended: 158.136, Last appended by leader: 136, Current term: 158, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.140223 23774 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 158 FOLLOWER]: Advancing to term 159
I20260319 16:36:10.159148 23768 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 158 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:10.159271 23768 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 158 FOLLOWER]: Advancing to term 159
I20260319 16:36:10.160063 23768 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.160226 23768 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 159 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:10.160651 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 159 candidate_status { last_received { term: 158 index: 136 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:10.160794 23426 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Leader election vote request: Denying vote to candidate df6bf03d752948d8a51e1ac8ac806839 in current term 159: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:10.160651 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 159 candidate_status { last_received { term: 158 index: 136 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.161680 23578 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 159 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 159.
I20260319 16:36:10.161990 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 159 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:10.162111 23768 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 FOLLOWER]: Leader election won for term 159
I20260319 16:36:10.162221 23768 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:10.162374 23768 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 136, Committed index: 136, Last appended: 158.136, Last appended by leader: 136, Current term: 159, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.163059 23320 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 158 to 159, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 159 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:10.248544 23578 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 159 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 158 index: 136. Preceding OpId from leader: term: 159 index: 137. (index mismatch)
I20260319 16:36:10.249011 23768 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20260319 16:36:10.250379 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 158 index: 136. Preceding OpId from leader: term: 159 index: 137. (index mismatch)
I20260319 16:36:10.250581 23769 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 137, Last known committed idx: 136, Time since last communication: 0.000s
I20260319 16:36:10.444489 23776 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:10.444595 23776 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 159 FOLLOWER]: Advancing to term 160
I20260319 16:36:10.445353 23776 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.445520 23776 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 160 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:10.445749 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 160 candidate_status { last_received { term: 159 index: 137 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.445755 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 160 candidate_status { last_received { term: 159 index: 137 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:10.446151 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 160 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29; no voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:10.446272 23776 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Leader election lost for term 160. Reason: could not achieve majority
I20260319 16:36:10.447260 23426 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 159. Current term is 160. Ops: []
I20260319 16:36:10.447538 23777 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: INVALID_TERM, Last received: 159.137, Next index: 138, Last known committed idx: 137, Time since last communication: 0.000s
I20260319 16:36:10.447672 23777 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 LEADER]: Stepping down as leader of term 159
I20260319 16:36:10.447705 23777 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:10.447772 23777 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 137, Committed index: 137, Last appended: 159.137, Last appended by leader: 137, Current term: 159, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.447849 23777 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 159 FOLLOWER]: Advancing to term 160
I20260319 16:36:10.459343 23774 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 159 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:10.459460 23774 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 159 FOLLOWER]: Advancing to term 160
I20260319 16:36:10.460358 23774 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.460542 23774 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 160 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:10.460909 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 160 candidate_status { last_received { term: 159 index: 137 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:10.461016 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 160 candidate_status { last_received { term: 159 index: 137 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:10.461107 23426 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Leader election vote request: Denying vote to candidate e60dc0e4f70541ecac7ceaa207d1eb0b in current term 160: Already voted for candidate 789b0cf57b7649c7b025aebb211c3b29 in this term.
I20260319 16:36:10.461604 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 160 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 160.
I20260319 16:36:10.461786 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 160 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:10.461869 23774 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 FOLLOWER]: Leader election won for term 160
I20260319 16:36:10.461922 23774 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:10.461979 23774 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 137, Committed index: 137, Last appended: 159.137, Last appended by leader: 137, Current term: 160, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.462744 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 159 to 160, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 160 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:10.543103 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 159 index: 137. Preceding OpId from leader: term: 160 index: 138. (index mismatch)
I20260319 16:36:10.543439 23774 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 138, Last known committed idx: 137, Time since last communication: 0.000s
I20260319 16:36:10.544955 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 160 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 159 index: 137. Preceding OpId from leader: term: 160 index: 138. (index mismatch)
I20260319 16:36:10.545149 23778 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 138, Last known committed idx: 137, Time since last communication: 0.000s
I20260319 16:36:10.742947 23777 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 160 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:10.743072 23777 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 160 FOLLOWER]: Advancing to term 161
I20260319 16:36:10.743914 23777 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.744104 23777 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 161 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:10.744485 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 161 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:10.744506 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 161 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.745002 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 161 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839; no voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:10.745151 23777 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Leader election lost for term 161. Reason: could not achieve majority
I20260319 16:36:10.760308 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Rejecting Update request from peer e60dc0e4f70541ecac7ceaa207d1eb0b for earlier term 160. Current term is 161. Ops: []
I20260319 16:36:10.760673 23775 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 160.138, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20260319 16:36:10.760917 23775 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 LEADER]: Stepping down as leader of term 160
I20260319 16:36:10.760959 23775 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 LEADER]: Becoming Follower/Learner. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:10.761023 23775 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 160.138, Last appended by leader: 138, Current term: 160, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.761111 23775 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 160 FOLLOWER]: Advancing to term 161
I20260319 16:36:10.821684 23776 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Starting leader election (detected failure of leader e60dc0e4f70541ecac7ceaa207d1eb0b)
I20260319 16:36:10.821810 23776 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 160 FOLLOWER]: Advancing to term 161
I20260319 16:36:10.824244 23776 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.824590 23776 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 161 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:10.824735 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 161 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.824769 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 161 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:10.824865 23502 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 161: Already voted for candidate df6bf03d752948d8a51e1ac8ac806839 in this term.
I20260319 16:36:10.825559 23578 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 161 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 161.
I20260319 16:36:10.826004 23390 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 161 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:10.826229 23776 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 FOLLOWER]: Leader election won for term 161
I20260319 16:36:10.826362 23776 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:10.826433 23776 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 160.138, Last appended by leader: 138, Current term: 161, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.827214 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 160 to 161, leader changed from e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 161 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:10.889853 23777 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:10.889967 23777 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 161 FOLLOWER]: Advancing to term 162
I20260319 16:36:10.890751 23777 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.892364 23777 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 162 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875)
I20260319 16:36:10.892623 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 162 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:10.892629 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "df6bf03d752948d8a51e1ac8ac806839" candidate_term: 162 candidate_status { last_received { term: 160 index: 138 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:10.892699 23578 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 161 FOLLOWER]: Advancing to term 162
I20260319 16:36:10.893361 23578 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 162 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6bf03d752948d8a51e1ac8ac806839 in term 162.
I20260319 16:36:10.893606 23466 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [CANDIDATE]: Term 162 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:10.893707 23777 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 FOLLOWER]: Leader election won for term 162
I20260319 16:36:10.893754 23777 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 LEADER]: Becoming Leader. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:10.893806 23777 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 160.138, Last appended by leader: 138, Current term: 162, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.894366 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 reported cstate change: term changed from 161 to 162, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66). New cstate: current_term: 162 leader_uuid: "df6bf03d752948d8a51e1ac8ac806839" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:10.909704 23578 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 162 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 161. Current term is 162. Ops: []
I20260319 16:36:10.910167 23776 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20260319 16:36:10.910295 23776 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 LEADER]: Stepping down as leader of term 161
I20260319 16:36:10.910324 23776 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:10.910454 23776 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 138, Committed index: 138, Last appended: 161.139, Last appended by leader: 139, Current term: 161, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:10.910570 23776 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 161 FOLLOWER]: Advancing to term 162
I20260319 16:36:10.974243 23426 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 162 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 161 index: 139. Preceding OpId from leader: term: 162 index: 139. (term mismatch)
I20260319 16:36:10.974360 23426 pending_rounds.cc:85] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting all ops after (but not including) 138
I20260319 16:36:10.974382 23426 pending_rounds.cc:107] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting uncommitted NO_OP operation due to leader change: 161.139
I20260319 16:36:10.974401 23426 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 162 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:10.974732 23777 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20260319 16:36:10.976594 23578 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 162 FOLLOWER]: Refusing update from remote peer df6bf03d752948d8a51e1ac8ac806839: Log matching property violated. Preceding OpId in replica: term: 160 index: 138. Preceding OpId from leader: term: 162 index: 139. (index mismatch)
I20260319 16:36:10.976867 23777 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 139, Last known committed idx: 138, Time since last communication: 0.000s
I20260319 16:36:11.078182 23775 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 162 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:11.078298 23775 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 162 FOLLOWER]: Advancing to term 163
I20260319 16:36:11.079136 23775 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.079324 23775 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 163 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:11.079571 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 163 candidate_status { last_received { term: 162 index: 139 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:11.079631 23426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 163 candidate_status { last_received { term: 162 index: 139 } } ignore_live_leader: false dest_uuid: "789b0cf57b7649c7b025aebb211c3b29"
I20260319 16:36:11.079847 23542 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839
I20260319 16:36:11.079998 23775 raft_consensus.cc:2749] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260319 16:36:11.084075 23578 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Rejecting Update request from peer df6bf03d752948d8a51e1ac8ac806839 for earlier term 162. Current term is 163. Ops: []
I20260319 16:36:11.084406 23780 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 }, Status: INVALID_TERM, Last received: 162.139, Next index: 140, Last known committed idx: 139, Time since last communication: 0.000s
I20260319 16:36:11.084597 23780 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 LEADER]: Stepping down as leader of term 162
I20260319 16:36:11.084647 23780 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 LEADER]: Becoming Follower/Learner. State: Replica: df6bf03d752948d8a51e1ac8ac806839, State: Running, Role: LEADER
I20260319 16:36:11.084715 23780 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 139, Committed index: 139, Last appended: 162.139, Last appended by leader: 139, Current term: 162, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.084801 23780 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 162 FOLLOWER]: Advancing to term 163
I20260319 16:36:11.118093 23293 timestamp_advancement-itest.cc:267] GCing logs...
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:267: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:403: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:332: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260319 16:36:11.118487 23293 tablet_server.cc:178] TabletServer@127.22.191.65:0 shutting down...
I20260319 16:36:11.158218 23776 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 162 FOLLOWER]: Starting leader election (detected failure of leader df6bf03d752948d8a51e1ac8ac806839)
I20260319 16:36:11.158460 23776 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 162 FOLLOWER]: Advancing to term 163
I20260319 16:36:11.159339 23776 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.159518 23776 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 163 election: Requested vote from peers e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67:39875), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:11.159848 23578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 163 candidate_status { last_received { term: 162 index: 139 } } ignore_live_leader: false dest_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b"
I20260319 16:36:11.159974 23578 raft_consensus.cc:2393] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate 789b0cf57b7649c7b025aebb211c3b29 in current term 163: Already voted for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in this term.
I20260319 16:36:11.160109 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "789b0cf57b7649c7b025aebb211c3b29" candidate_term: 163 candidate_status { last_received { term: 162 index: 139 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
I20260319 16:36:11.161091 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 163 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 789b0cf57b7649c7b025aebb211c3b29 in term 163.
I20260319 16:36:11.161360 23392 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [CANDIDATE]: Term 163 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 789b0cf57b7649c7b025aebb211c3b29, df6bf03d752948d8a51e1ac8ac806839; no voters: e60dc0e4f70541ecac7ceaa207d1eb0b
I20260319 16:36:11.161510 23776 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 FOLLOWER]: Leader election won for term 163
I20260319 16:36:11.161581 23776 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 LEADER]: Becoming Leader. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:11.161703 23776 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 139, Committed index: 139, Last appended: 162.139, Last appended by leader: 139, Current term: 163, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.162557 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 reported cstate change: term changed from 162 to 163, leader changed from df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66) to 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65). New cstate: current_term: 163 leader_uuid: "789b0cf57b7649c7b025aebb211c3b29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:11.210702 23775 raft_consensus.cc:493] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:11.210922 23775 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 163 FOLLOWER]: Advancing to term 164
I20260319 16:36:11.211690 23775 raft_consensus.cc:515] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 164 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.211877 23775 leader_election.cc:290] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 164 election: Requested vote from peers 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295), df6bf03d752948d8a51e1ac8ac806839 (127.22.191.66:38161)
I20260319 16:36:11.212198 23502 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53746d9ba488446e8cf4a7138ef8ce6f" candidate_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" candidate_term: 164 candidate_status { last_received { term: 162 index: 139 } } ignore_live_leader: false dest_uuid: "df6bf03d752948d8a51e1ac8ac806839"
W20260319 16:36:11.212198 23542 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260319 16:36:11.212330 23502 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 163 FOLLOWER]: Advancing to term 164
W20260319 16:36:11.212914 23542 leader_election.cc:336] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 164 election: RPC error from VoteRequest() call to peer 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260319 16:36:11.213320 23502 raft_consensus.cc:2468] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 164 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e60dc0e4f70541ecac7ceaa207d1eb0b in term 164.
I20260319 16:36:11.213513 23544 leader_election.cc:304] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [CANDIDATE]: Term 164 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df6bf03d752948d8a51e1ac8ac806839, e60dc0e4f70541ecac7ceaa207d1eb0b; no voters: 789b0cf57b7649c7b025aebb211c3b29
I20260319 16:36:11.213696 23775 raft_consensus.cc:2804] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 164 FOLLOWER]: Leader election won for term 164
I20260319 16:36:11.213881 23775 raft_consensus.cc:697] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 164 LEADER]: Becoming Leader. State: Replica: e60dc0e4f70541ecac7ceaa207d1eb0b, State: Running, Role: LEADER
I20260319 16:36:11.213982 23775 consensus_queue.cc:237] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 139, Committed index: 139, Last appended: 162.139, Last appended by leader: 139, Current term: 164, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.214941 23321 catalog_manager.cc:5671] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b reported cstate change: term changed from 163 to 164, leader changed from 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65) to e60dc0e4f70541ecac7ceaa207d1eb0b (127.22.191.67). New cstate: current_term: 164 leader_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:11.266031 23502 raft_consensus.cc:1240] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 164 FOLLOWER]: Rejecting Update request from peer 789b0cf57b7649c7b025aebb211c3b29 for earlier term 163. Current term is 164. Ops: []
I20260319 16:36:11.266491 23776 consensus_queue.cc:1059] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: INVALID_TERM, Last received: 0.0, Next index: 140, Last known committed idx: 139, Time since last communication: 0.000s
I20260319 16:36:11.266619 23776 raft_consensus.cc:3055] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 LEADER]: Stepping down as leader of term 163
I20260319 16:36:11.266636 23776 raft_consensus.cc:740] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 LEADER]: Becoming Follower/Learner. State: Replica: 789b0cf57b7649c7b025aebb211c3b29, State: Running, Role: LEADER
I20260319 16:36:11.266688 23776 consensus_queue.cc:260] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 139, Committed index: 139, Last appended: 163.140, Last appended by leader: 140, Current term: 163, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "789b0cf57b7649c7b025aebb211c3b29" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 39295 } } peers { permanent_uuid: "e60dc0e4f70541ecac7ceaa207d1eb0b" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39875 } } peers { permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 } }
I20260319 16:36:11.266767 23776 raft_consensus.cc:3060] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 163 FOLLOWER]: Advancing to term 164
I20260319 16:36:11.294373 23502 raft_consensus.cc:1275] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 164 FOLLOWER]: Refusing update from remote peer e60dc0e4f70541ecac7ceaa207d1eb0b: Log matching property violated. Preceding OpId in replica: term: 162 index: 139. Preceding OpId from leader: term: 164 index: 140. (index mismatch)
I20260319 16:36:11.294792 23775 consensus_queue.cc:1048] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6bf03d752948d8a51e1ac8ac806839" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 140, Last known committed idx: 139, Time since last communication: 0.000s
W20260319 16:36:11.296650 23542 consensus_peers.cc:597] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b -> Peer 789b0cf57b7649c7b025aebb211c3b29 (127.22.191.65:39295): Couldn't send request to peer 789b0cf57b7649c7b025aebb211c3b29. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260319 16:36:11.304313 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:11.304579 23293 tablet_replica.cc:333] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: stopping tablet replica
I20260319 16:36:11.304682 23293 raft_consensus.cc:2243] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 164 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:11.304749 23293 pending_rounds.cc:70] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Trying to abort 1 pending ops.
I20260319 16:36:11.304785 23293 pending_rounds.cc:77] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29: Aborting op as it isn't in flight: id { term: 163 index: 140 } timestamp: 7266050749079445504 op_type: NO_OP noop_request { }
I20260319 16:36:11.304852 23293 raft_consensus.cc:2889] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 164 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260319 16:36:11.304883 23293 raft_consensus.cc:2272] T 53746d9ba488446e8cf4a7138ef8ce6f P 789b0cf57b7649c7b025aebb211c3b29 [term 164 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:11.319111 23293 tablet_server.cc:195] TabletServer@127.22.191.65:0 shutdown complete.
I20260319 16:36:11.321003 23293 tablet_server.cc:178] TabletServer@127.22.191.66:0 shutting down...
I20260319 16:36:11.346607 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:11.346920 23293 tablet_replica.cc:333] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839: stopping tablet replica
I20260319 16:36:11.346994 23293 raft_consensus.cc:2243] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 164 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:11.347043 23293 raft_consensus.cc:2272] T 53746d9ba488446e8cf4a7138ef8ce6f P df6bf03d752948d8a51e1ac8ac806839 [term 164 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:11.353555 23293 tablet_server.cc:195] TabletServer@127.22.191.66:0 shutdown complete.
I20260319 16:36:11.354817 23293 tablet_server.cc:178] TabletServer@127.22.191.67:0 shutting down...
I20260319 16:36:11.365432 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:11.365659 23293 tablet_replica.cc:333] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b: stopping tablet replica
I20260319 16:36:11.365739 23293 raft_consensus.cc:2243] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 164 LEADER]: Raft consensus shutting down.
I20260319 16:36:11.365916 23293 raft_consensus.cc:2272] T 53746d9ba488446e8cf4a7138ef8ce6f P e60dc0e4f70541ecac7ceaa207d1eb0b [term 164 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:11.379156 23293 tablet_server.cc:195] TabletServer@127.22.191.67:0 shutdown complete.
I20260319 16:36:11.380421 23293 master.cc:561] Master@127.22.191.126:43153 shutting down...
I20260319 16:36:11.470674 23293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:11.470896 23293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:11.470940 23293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 70b52d248f704da49a3d22a9e2128026: stopping tablet replica
I20260319 16:36:11.484464 23293 master.cc:583] Master@127.22.191.126:43153 shutdown complete.
I20260319 16:36:11.487077 23293 test_util.cc:183] -----------------------------------------------
I20260319 16:36:11.487141 23293 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1773938138919687-23293-0
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (32563 ms)
[ RUN ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260319 16:36:11.487679 23293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.191.126:44511
I20260319 16:36:11.487830 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:11.490070 23782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.490104 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:11.490283 23785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:11.490288 23783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.490485 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:11.490525 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:11.490541 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938171490541 us; error 0 us; skew 500 ppm
I20260319 16:36:11.491278 23293 webserver.cc:492] Webserver started at http://127.22.191.126:41735/ using document root <none> and password file <none>
I20260319 16:36:11.491367 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:11.491415 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:11.491462 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:11.491736 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/master-0-root/instance:
uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.492949 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:11.493633 23790 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.493858 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:11.493909 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/master-0-root
uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.493954 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:11.502488 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:11.502714 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:11.506343 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.126:44511
I20260319 16:36:11.508229 23842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.126:44511 every 8 connection(s)
I20260319 16:36:11.508419 23843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:11.509663 23843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7: Bootstrap starting.
I20260319 16:36:11.510000 23843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:11.510553 23843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7: No bootstrap required, opened a new log
I20260319 16:36:11.510695 23843 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER }
I20260319 16:36:11.510869 23843 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:11.510890 23843 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a55a0c371bf4c0dabdbeb74ac0cd5f7, State: Initialized, Role: FOLLOWER
I20260319 16:36:11.510939 23843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER }
I20260319 16:36:11.510979 23843 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:11.510998 23843 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:11.511014 23843 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:11.511794 23843 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER }
I20260319 16:36:11.511878 23843 leader_election.cc:304] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8a55a0c371bf4c0dabdbeb74ac0cd5f7; no voters:
I20260319 16:36:11.512002 23843 leader_election.cc:290] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260319 16:36:11.512154 23846 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:11.512161 23843 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260319 16:36:11.512339 23846 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 1 LEADER]: Becoming Leader. State: Replica: 8a55a0c371bf4c0dabdbeb74ac0cd5f7, State: Running, Role: LEADER
I20260319 16:36:11.512404 23846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER }
I20260319 16:36:11.512728 23847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER } }
I20260319 16:36:11.512815 23847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:11.512738 23848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8a55a0c371bf4c0dabdbeb74ac0cd5f7. Latest consensus state: current_term: 1 leader_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8a55a0c371bf4c0dabdbeb74ac0cd5f7" member_type: VOTER } }
I20260319 16:36:11.512856 23848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:11.512956 23855 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260319 16:36:11.513135 23855 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260319 16:36:11.513787 23293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260319 16:36:11.514205 23855 catalog_manager.cc:1357] Generated new cluster ID: 6b0e0b103ccf4d9d9f5761aa448ea89c
I20260319 16:36:11.514253 23855 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260319 16:36:11.521431 23855 catalog_manager.cc:1380] Generated new certificate authority record
I20260319 16:36:11.521970 23855 catalog_manager.cc:1514] Loading token signing keys...
I20260319 16:36:11.532920 23855 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7: Generated new TSK 0
I20260319 16:36:11.533102 23855 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260319 16:36:11.546077 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:36:11.546214 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:36:11.547883 23864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:11.547953 23865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.547914 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:11.547894 23867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.548511 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:11.548558 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:11.548578 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938171548578 us; error 0 us; skew 500 ppm
I20260319 16:36:11.549304 23293 webserver.cc:492] Webserver started at http://127.22.191.65:39109/ using document root <none> and password file <none>
I20260319 16:36:11.549394 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:11.549443 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:11.549494 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:11.549846 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root/instance:
uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.550892 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:11.551518 23872 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.551838 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:11.551898 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.551957 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:11.575518 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:11.575763 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:11.575946 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:11.576164 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:11.576193 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.576223 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:11.576244 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.580945 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:44565
I20260319 16:36:11.581151 23935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:44565 every 8 connection(s)
I20260319 16:36:11.581835 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:36:11.582039 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:36:11.583750 23941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:11.583998 23940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.584095 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:11.583999 23943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.584405 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:11.584445 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:11.584462 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938171584462 us; error 0 us; skew 500 ppm
I20260319 16:36:11.585230 23293 webserver.cc:492] Webserver started at http://127.22.191.66:33729/ using document root <none> and password file <none>
I20260319 16:36:11.585495 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:11.585538 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:11.585708 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:11.586195 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-1-root/instance:
uuid: "d33022cf348645d8899f0bdfd1f56269"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.587345 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260319 16:36:11.588160 23948 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.588438 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:11.588503 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-1-root
uuid: "d33022cf348645d8899f0bdfd1f56269"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.588562 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:11.590198 23936 heartbeater.cc:344] Connected to a master server at 127.22.191.126:44511
I20260319 16:36:11.590277 23936 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:11.590400 23936 heartbeater.cc:507] Master 127.22.191.126:44511 requested a full tablet report, sending...
I20260319 16:36:11.590677 23805 ts_manager.cc:194] Registered new tserver with Master: 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565)
I20260319 16:36:11.591349 23805 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37898
I20260319 16:36:11.607868 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:11.608086 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:11.608320 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:11.608546 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:11.608574 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.608605 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:11.608632 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.612743 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.66:40775
I20260319 16:36:11.612938 24011 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.66:40775 every 8 connection(s)
I20260319 16:36:11.613166 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:36:11.613289 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:36:11.616037 24015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:11.616122 24018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:11.616124 24016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:11.616389 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:11.616519 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:11.616554 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:11.616570 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938171616571 us; error 0 us; skew 500 ppm
I20260319 16:36:11.617558 23293 webserver.cc:492] Webserver started at http://127.22.191.67:44773/ using document root <none> and password file <none>
I20260319 16:36:11.617692 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:11.617745 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:11.617797 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:11.617926 24012 heartbeater.cc:344] Connected to a master server at 127.22.191.126:44511
I20260319 16:36:11.618001 24012 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:11.618261 24012 heartbeater.cc:507] Master 127.22.191.126:44511 requested a full tablet report, sending...
I20260319 16:36:11.618381 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-2-root/instance:
uuid: "462e25def85f4f0cb068219037b32bc2"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.618726 23805 ts_manager.cc:194] Registered new tserver with Master: d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:11.619179 23805 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37900
I20260319 16:36:11.619684 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260319 16:36:11.620379 24023 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.620855 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:11.620929 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-2-root
uuid: "462e25def85f4f0cb068219037b32bc2"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:11.620990 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:11.639326 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:11.639627 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:11.639814 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:11.640018 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:11.640049 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.640091 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:11.640115 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.643482 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.67:33269
I20260319 16:36:11.643573 24086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.67:33269 every 8 connection(s)
I20260319 16:36:11.647284 24087 heartbeater.cc:344] Connected to a master server at 127.22.191.126:44511
I20260319 16:36:11.647367 24087 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:11.647477 24087 heartbeater.cc:507] Master 127.22.191.126:44511 requested a full tablet report, sending...
I20260319 16:36:11.647715 23805 ts_manager.cc:194] Registered new tserver with Master: 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:11.648082 23805 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37912
I20260319 16:36:11.648201 23293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004535849s
I20260319 16:36:11.663769 23805 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37940:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260319 16:36:11.663939 23805 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260319 16:36:11.669607 24051 tablet_service.cc:1511] Processing CreateTablet for tablet 3b20fa20df0c46e184bd9bba694b8ee2 (DEFAULT_TABLE table=test-workload [id=e1f815eb4e4f4c678df6d0d6cc485ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:11.669808 23900 tablet_service.cc:1511] Processing CreateTablet for tablet 3b20fa20df0c46e184bd9bba694b8ee2 (DEFAULT_TABLE table=test-workload [id=e1f815eb4e4f4c678df6d0d6cc485ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:11.669876 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b20fa20df0c46e184bd9bba694b8ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:11.669907 23900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b20fa20df0c46e184bd9bba694b8ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:11.671391 24108 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Bootstrap starting.
I20260319 16:36:11.671499 23976 tablet_service.cc:1511] Processing CreateTablet for tablet 3b20fa20df0c46e184bd9bba694b8ee2 (DEFAULT_TABLE table=test-workload [id=e1f815eb4e4f4c678df6d0d6cc485ef0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:11.671605 23976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b20fa20df0c46e184bd9bba694b8ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:11.671972 24108 tablet_bootstrap.cc:654] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:11.672567 24108 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: No bootstrap required, opened a new log
I20260319 16:36:11.672595 24109 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Bootstrap starting.
I20260319 16:36:11.672628 24108 ts_tablet_manager.cc:1403] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:11.672827 24111 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: Bootstrap starting.
I20260319 16:36:11.672863 24108 raft_consensus.cc:359] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.672936 24108 raft_consensus.cc:385] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:11.672987 24108 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Initialized, Role: FOLLOWER
I20260319 16:36:11.673066 24108 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.673084 24109 tablet_bootstrap.cc:654] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:11.673243 24108 ts_tablet_manager.cc:1434] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:11.673283 23936 heartbeater.cc:499] Master 127.22.191.126:44511 was elected leader, sending a full tablet report...
I20260319 16:36:11.673282 24111 tablet_bootstrap.cc:654] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:11.673781 24109 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: No bootstrap required, opened a new log
I20260319 16:36:11.673825 24109 ts_tablet_manager.cc:1403] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:11.673972 24109 raft_consensus.cc:359] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.674037 24109 raft_consensus.cc:385] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:11.674036 24111 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: No bootstrap required, opened a new log
I20260319 16:36:11.674160 24111 ts_tablet_manager.cc:1403] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:11.674367 24111 raft_consensus.cc:359] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.674413 24111 raft_consensus.cc:385] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:11.674425 24111 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Initialized, Role: FOLLOWER
I20260319 16:36:11.674475 24111 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.674654 24111 ts_tablet_manager.cc:1434] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:11.674078 24109 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 462e25def85f4f0cb068219037b32bc2, State: Initialized, Role: FOLLOWER
I20260319 16:36:11.674693 24012 heartbeater.cc:499] Master 127.22.191.126:44511 was elected leader, sending a full tablet report...
I20260319 16:36:11.674767 24109 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.674932 24109 ts_tablet_manager.cc:1434] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:11.675004 24087 heartbeater.cc:499] Master 127.22.191.126:44511 was elected leader, sending a full tablet report...
I20260319 16:36:11.700511 24112 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260319 16:36:11.700626 24112 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.700917 24112 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:11.703846 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2" is_pre_election: true
I20260319 16:36:11.703956 24061 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 0.
I20260319 16:36:11.704020 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269" is_pre_election: true
I20260319 16:36:11.704119 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 0.
I20260319 16:36:11.704362 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269; no voters:
I20260319 16:36:11.704497 24112 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260319 16:36:11.704550 24112 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:11.704578 24112 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:11.705307 24112 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.705423 24112 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 1 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:11.705613 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:11.705670 23986 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:11.705643 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:11.705709 24061 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:11.706285 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 1.
I20260319 16:36:11.706483 24061 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 1.
I20260319 16:36:11.706496 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269; no voters:
I20260319 16:36:11.706599 24112 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:11.706761 24112 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 LEADER]: Becoming Leader. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:11.706827 24112 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:11.707713 23805 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65). New cstate: current_term: 1 leader_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:11.719084 23986 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 1 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260319 16:36:11.719120 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 1 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260319 16:36:11.719370 24126 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:36:11.719528 24118 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:36:11.722368 24128 mvcc.cc:204] Tried to move back new op lower bound from 7266050751361384448 to 7266050751311966208. Current Snapshot: MvccSnapshot[applied={T|T < 7266050751361384448 or (T in {7266050751361384448})}]
I20260319 16:36:12.032677 24115 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7563fd6ee62f4413ba4e70ef0a29be20)
I20260319 16:36:12.032792 24115 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:36:12.033628 24115 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.033843 24115 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 2 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.036477 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.036478 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.036724 23952 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d33022cf348645d8899f0bdfd1f56269; no voters: 462e25def85f4f0cb068219037b32bc2, 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:12.036836 24115 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260319 16:36:12.044333 23986 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 2 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 1. Current term is 2. Ops: []
I20260319 16:36:12.044649 24142 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: INVALID_TERM, Last received: 1.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260319 16:36:12.100049 24142 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 LEADER]: Stepping down as leader of term 1
I20260319 16:36:12.100157 24142 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:12.100232 24142 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.100414 24142 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:36:12.156958 24115 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:12.157083 24115 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:36:12.157883 24115 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.158053 24115 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 3 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.158267 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.158335 23908 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:36:12.158278 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.158987 23908 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d33022cf348645d8899f0bdfd1f56269 in term 3.
I20260319 16:36:12.159175 23950 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269; no voters: 462e25def85f4f0cb068219037b32bc2
I20260319 16:36:12.159268 24115 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 FOLLOWER]: Leader election won for term 3
I20260319 16:36:12.159503 24115 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 LEADER]: Becoming Leader. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:12.159592 24115 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.160171 23806 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 reported cstate change: term changed from 1 to 3, leader changed from 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65) to d33022cf348645d8899f0bdfd1f56269 (127.22.191.66). New cstate: current_term: 3 leader_uuid: "d33022cf348645d8899f0bdfd1f56269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:12.182991 24116 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7563fd6ee62f4413ba4e70ef0a29be20)
I20260319 16:36:12.183120 24116 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:36:12.184054 24116 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.184309 24116 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 2 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:12.187222 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:12.187366 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.187474 23908 raft_consensus.cc:2368] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 462e25def85f4f0cb068219037b32bc2 for earlier term 2. Current term is 3.
I20260319 16:36:12.187628 24025 leader_election.cc:400] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 2 election: Vote denied by peer 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565) with higher term. Message: Invalid argument: T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 462e25def85f4f0cb068219037b32bc2 for earlier term 2. Current term is 3.
I20260319 16:36:12.187680 24025 leader_election.cc:403] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260319 16:36:12.187742 24116 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 2 FOLLOWER]: Advancing to term 3
I20260319 16:36:12.188444 24116 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565) with higher term. Message: Invalid argument: T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 462e25def85f4f0cb068219037b32bc2 for earlier term 2. Current term is 3.
I20260319 16:36:12.253515 23908 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260319 16:36:12.253572 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 3 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 3 index: 16. (index mismatch)
I20260319 16:36:12.253808 24115 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260319 16:36:12.253944 24144 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260319 16:36:12.438316 24116 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:12.438504 24116 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:36:12.439371 24116 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.439568 24116 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 4 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:12.439851 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.439946 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:12.440248 24027 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2; no voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:12.440410 24116 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260319 16:36:12.442901 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 4 FOLLOWER]: Rejecting Update request from peer d33022cf348645d8899f0bdfd1f56269 for earlier term 3. Current term is 4. Ops: []
I20260319 16:36:12.443344 24147 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 3.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:12.446449 24142 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:12.446545 24142 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:36:12.447356 24142 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.447675 24142 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 4 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.448064 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:12.448001 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 4 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.448180 24061 raft_consensus.cc:2393] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7563fd6ee62f4413ba4e70ef0a29be20 in current term 4: Already voted for candidate 462e25def85f4f0cb068219037b32bc2 in this term.
I20260319 16:36:12.448355 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20; no voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:12.448496 24142 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260319 16:36:12.466921 23908 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 4 FOLLOWER]: Rejecting Update request from peer d33022cf348645d8899f0bdfd1f56269 for earlier term 3. Current term is 4. Ops: []
I20260319 16:36:12.467278 24147 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: INVALID_TERM, Last received: 3.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:12.492511 24144 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 LEADER]: Stepping down as leader of term 3
I20260319 16:36:12.492617 24144 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:12.492848 24144 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 3.16, Last appended by leader: 16, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.493013 24144 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 3 FOLLOWER]: Advancing to term 4
I20260319 16:36:12.555603 24142 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:12.555713 24142 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:36:12.556517 24142 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.556668 24142 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 5 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.556957 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 5 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.556986 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 5 candidate_status { last_received { term: 3 index: 16 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:12.557046 24061 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:36:12.557075 23986 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 4 FOLLOWER]: Advancing to term 5
I20260319 16:36:12.557749 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 5.
I20260319 16:36:12.557935 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269; no voters:
I20260319 16:36:12.557994 24061 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 5.
I20260319 16:36:12.558017 24142 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 FOLLOWER]: Leader election won for term 5
I20260319 16:36:12.558130 24142 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 LEADER]: Becoming Leader. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:12.558200 24142 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 3.16, Last appended by leader: 16, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.558712 23804 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 reported cstate change: term changed from 3 to 5, leader changed from d33022cf348645d8899f0bdfd1f56269 (127.22.191.66) to 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65). New cstate: current_term: 5 leader_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:12.638127 23986 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 5 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 3 index: 16. Preceding OpId from leader: term: 5 index: 17. (index mismatch)
I20260319 16:36:12.638382 24142 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:12.643565 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 5 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 3 index: 16. Preceding OpId from leader: term: 5 index: 17. (index mismatch)
I20260319 16:36:12.643996 24112 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:12.740839 24144 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7563fd6ee62f4413ba4e70ef0a29be20)
I20260319 16:36:12.740950 24144 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:36:12.741669 24144 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.741840 24144 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 6 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.742111 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.742164 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.742372 23952 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d33022cf348645d8899f0bdfd1f56269; no voters: 462e25def85f4f0cb068219037b32bc2, 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:12.742466 24144 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260319 16:36:12.743587 23986 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 5. Current term is 6. Ops: []
I20260319 16:36:12.743957 24152 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: INVALID_TERM, Last received: 5.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:12.744956 24151 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7563fd6ee62f4413ba4e70ef0a29be20)
I20260319 16:36:12.745028 24151 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:36:12.745714 24151 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.745842 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 6 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 5. Current term is 6. Ops: []
I20260319 16:36:12.745882 24151 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 6 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:12.746124 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:12.746148 24112 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 5.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:12.746236 23986 raft_consensus.cc:2393] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 462e25def85f4f0cb068219037b32bc2 in current term 6: Already voted for candidate d33022cf348645d8899f0bdfd1f56269 in this term.
I20260319 16:36:12.746177 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 6 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.746529 24027 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2; no voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:12.746676 24151 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260319 16:36:12.823433 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 6 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 5. Current term is 6. Ops: []
I20260319 16:36:12.823864 24142 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 5.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:12.856577 23986 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 5. Current term is 6. Ops: []
I20260319 16:36:12.856911 24152 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: INVALID_TERM, Last received: 5.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:12.861948 24144 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:12.862193 24144 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:36:12.862995 24144 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.863168 24144 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 7 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:12.863407 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 7 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:12.863495 24061 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:36:12.863406 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 7 candidate_status { last_received { term: 5 index: 17 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:12.864192 24061 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d33022cf348645d8899f0bdfd1f56269 in term 7.
I20260319 16:36:12.864400 23952 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269; no voters: 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:12.864532 24144 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 FOLLOWER]: Leader election won for term 7
I20260319 16:36:12.864609 24144 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 LEADER]: Becoming Leader. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:12.864670 24144 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 5.17, Last appended by leader: 17, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.865262 23804 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 reported cstate change: term changed from 5 to 7, leader changed from 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65) to d33022cf348645d8899f0bdfd1f56269 (127.22.191.66). New cstate: current_term: 7 leader_uuid: "d33022cf348645d8899f0bdfd1f56269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:12.880637 24112 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 LEADER]: Stepping down as leader of term 5
I20260319 16:36:12.880752 24112 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:12.880914 24112 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 5.17, Last appended by leader: 17, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:12.881081 24112 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 5 FOLLOWER]: Advancing to term 6
I20260319 16:36:12.954931 23908 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 6 FOLLOWER]: Advancing to term 7
I20260319 16:36:12.955718 23908 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 7 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 5 index: 17. Preceding OpId from leader: term: 7 index: 18. (index mismatch)
I20260319 16:36:12.956097 24144 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:12.961860 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 7 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 5 index: 17. Preceding OpId from leader: term: 7 index: 18. (index mismatch)
I20260319 16:36:12.962205 24144 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:13.136582 24112 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:13.136689 24112 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:36:13.137357 24112 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.137521 24112 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 8 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:13.137773 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.137866 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:13.138052 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20; no voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:13.138198 24112 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260319 16:36:13.142979 23908 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Rejecting Update request from peer d33022cf348645d8899f0bdfd1f56269 for earlier term 7. Current term is 8. Ops: []
I20260319 16:36:13.143286 24144 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: INVALID_TERM, Last received: 7.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:13.153605 24147 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 LEADER]: Stepping down as leader of term 7
I20260319 16:36:13.153703 24147 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:13.153770 24147 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 7.18, Last appended by leader: 18, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.153939 24147 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:36:13.241117 24151 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 7 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:13.241233 24151 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 7 FOLLOWER]: Advancing to term 8
I20260319 16:36:13.241931 24151 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.242231 24151 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 8 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:13.242372 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.242372 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 8 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:13.242501 23908 raft_consensus.cc:2393] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 462e25def85f4f0cb068219037b32bc2 in current term 8: Already voted for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in this term.
I20260319 16:36:13.243079 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462e25def85f4f0cb068219037b32bc2 in term 8.
I20260319 16:36:13.243369 24027 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269; no voters: 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:13.243492 24151 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 FOLLOWER]: Leader election won for term 8
I20260319 16:36:13.243688 24151 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 LEADER]: Becoming Leader. State: Replica: 462e25def85f4f0cb068219037b32bc2, State: Running, Role: LEADER
I20260319 16:36:13.243841 24151 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 7.18, Last appended by leader: 18, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.244467 23807 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 reported cstate change: term changed from 7 to 8, leader changed from d33022cf348645d8899f0bdfd1f56269 (127.22.191.66) to 462e25def85f4f0cb068219037b32bc2 (127.22.191.67). New cstate: current_term: 8 leader_uuid: "462e25def85f4f0cb068219037b32bc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:13.251637 24112 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:13.251757 24112 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:36:13.252547 24112 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.252707 24112 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 9 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:13.252925 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 9 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.252997 23986 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:36:13.253011 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 9 candidate_status { last_received { term: 7 index: 18 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:13.253578 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7563fd6ee62f4413ba4e70ef0a29be20 in term 9.
I20260319 16:36:13.253878 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269; no voters: 462e25def85f4f0cb068219037b32bc2
I20260319 16:36:13.253981 24112 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 FOLLOWER]: Leader election won for term 9
I20260319 16:36:13.254034 24112 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 LEADER]: Becoming Leader. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:13.254076 24112 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 7.18, Last appended by leader: 18, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.320214 23908 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 LEADER]: Rejecting Update request from peer 462e25def85f4f0cb068219037b32bc2 for earlier term 8. Current term is 9. Ops: []
I20260319 16:36:13.320614 24151 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:13.320848 24151 consensus_queue.cc:1243] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Peer 7563fd6ee62f4413ba4e70ef0a29be20 log is divergent from this leader: its last log entry 9.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260319 16:36:13.328717 23806 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 reported cstate change: term changed from 8 to 9, leader changed from 462e25def85f4f0cb068219037b32bc2 (127.22.191.67) to 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65). New cstate: current_term: 9 leader_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:13.351274 23986 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 9 FOLLOWER]: Rejecting Update request from peer 462e25def85f4f0cb068219037b32bc2 for earlier term 8. Current term is 9. Ops: []
I20260319 16:36:13.351585 24151 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:13.352077 24153 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 LEADER]: Stepping down as leader of term 8
I20260319 16:36:13.352134 24153 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 462e25def85f4f0cb068219037b32bc2, State: Running, Role: LEADER
I20260319 16:36:13.352190 24153 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 8.19, Last appended by leader: 19, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.352313 24153 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 8 FOLLOWER]: Advancing to term 9
I20260319 16:36:13.360288 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 9 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 8 index: 19. Preceding OpId from leader: term: 9 index: 19. (term mismatch)
I20260319 16:36:13.360374 24061 pending_rounds.cc:85] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Aborting all ops after (but not including) 18
I20260319 16:36:13.360387 24061 pending_rounds.cc:107] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: Aborting uncommitted NO_OP operation due to leader change: 8.19
I20260319 16:36:13.360400 24061 raft_consensus.cc:2889] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260319 16:36:13.360708 24142 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:13.360987 23986 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 9 FOLLOWER]: Refusing update from remote peer 7563fd6ee62f4413ba4e70ef0a29be20: Log matching property violated. Preceding OpId in replica: term: 7 index: 18. Preceding OpId from leader: term: 9 index: 19. (index mismatch)
I20260319 16:36:13.361234 24142 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:13.462954 24147 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7563fd6ee62f4413ba4e70ef0a29be20)
I20260319 16:36:13.463086 24147 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:36:13.463908 24147 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.464092 24147 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 10 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:13.464365 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 10 candidate_status { last_received { term: 9 index: 19 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:13.464399 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 10 candidate_status { last_received { term: 9 index: 19 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:13.464506 24061 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:36:13.465188 24061 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d33022cf348645d8899f0bdfd1f56269 in term 10.
I20260319 16:36:13.465394 23952 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269; no voters: 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:13.465487 24147 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 FOLLOWER]: Leader election won for term 10
I20260319 16:36:13.465539 24147 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 LEADER]: Becoming Leader. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:13.465590 24147 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 9.19, Last appended by leader: 19, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.466154 23807 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 reported cstate change: term changed from 9 to 10, leader changed from 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65) to d33022cf348645d8899f0bdfd1f56269 (127.22.191.66). New cstate: current_term: 10 leader_uuid: "d33022cf348645d8899f0bdfd1f56269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: UNKNOWN } } }
I20260319 16:36:13.468531 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 10 FOLLOWER]: Rejecting Update request from peer 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 9. Current term is 10. Ops: []
I20260319 16:36:13.468878 24142 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 9.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260319 16:36:13.477979 24154 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 LEADER]: Stepping down as leader of term 9
I20260319 16:36:13.478160 24154 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Running, Role: LEADER
I20260319 16:36:13.478317 24154 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 9.19, Last appended by leader: 19, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.478432 24154 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 9 FOLLOWER]: Advancing to term 10
I20260319 16:36:13.550030 24061 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 10 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 9 index: 19. Preceding OpId from leader: term: 10 index: 20. (index mismatch)
I20260319 16:36:13.550235 23908 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 10 FOLLOWER]: Refusing update from remote peer d33022cf348645d8899f0bdfd1f56269: Log matching property violated. Preceding OpId in replica: term: 9 index: 19. Preceding OpId from leader: term: 10 index: 20. (index mismatch)
I20260319 16:36:13.550292 24147 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260319 16:36:13.550531 24147 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260319 16:36:13.652498 24153 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:13.652599 24153 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:36:13.653319 24153 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.653467 24153 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 11 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:13.653707 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:13.653808 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 11 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.654031 24027 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2; no voters: 7563fd6ee62f4413ba4e70ef0a29be20, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:13.654126 24153 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260319 16:36:13.666450 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Rejecting Update request from peer d33022cf348645d8899f0bdfd1f56269 for earlier term 10. Current term is 11. Ops: []
I20260319 16:36:13.666886 24144 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 10.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260319 16:36:13.765163 24061 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Rejecting Update request from peer d33022cf348645d8899f0bdfd1f56269 for earlier term 10. Current term is 11. Ops: []
I20260319 16:36:13.765452 24115 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 }, Status: INVALID_TERM, Last received: 10.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260319 16:36:13.797015 24147 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 LEADER]: Stepping down as leader of term 10
I20260319 16:36:13.797137 24147 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: d33022cf348645d8899f0bdfd1f56269, State: Running, Role: LEADER
I20260319 16:36:13.797214 24147 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 10.20, Last appended by leader: 20, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.797335 24147 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:36:13.797575 24153 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:13.797645 24153 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:36:13.798365 24153 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.798537 24153 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 12 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775)
I20260319 16:36:13.798760 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 12 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.798835 23986 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:36:13.798879 23908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "462e25def85f4f0cb068219037b32bc2" candidate_term: 12 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
I20260319 16:36:13.799477 23986 raft_consensus.cc:2468] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 462e25def85f4f0cb068219037b32bc2 in term 12.
I20260319 16:36:13.799721 24027 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269; no voters: 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:13.799901 24153 raft_consensus.cc:2804] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 FOLLOWER]: Leader election won for term 12
I20260319 16:36:13.799978 24153 raft_consensus.cc:697] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 LEADER]: Becoming Leader. State: Replica: 462e25def85f4f0cb068219037b32bc2, State: Running, Role: LEADER
I20260319 16:36:13.800029 24153 consensus_queue.cc:237] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 10.20, Last appended by leader: 20, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.800493 23804 catalog_manager.cc:5671] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 reported cstate change: term changed from 10 to 12, leader changed from d33022cf348645d8899f0bdfd1f56269 (127.22.191.66) to 462e25def85f4f0cb068219037b32bc2 (127.22.191.67). New cstate: current_term: 12 leader_uuid: "462e25def85f4f0cb068219037b32bc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:13.831445 24154 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 10 FOLLOWER]: Starting leader election (detected failure of leader d33022cf348645d8899f0bdfd1f56269)
I20260319 16:36:13.831562 24154 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 10 FOLLOWER]: Advancing to term 11
I20260319 16:36:13.832433 24154 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:13.832615 24154 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 11 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:13.832628 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:13.832741 23293 log_reader.cc:385] T 3b20fa20df0c46e184bd9bba694b8ee2: removed 1 log segments from log reader
I20260319 16:36:13.832773 23293 log.cc:1079] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Deleting log segment in path: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root/wals/3b20fa20df0c46e184bd9bba694b8ee2/wal-000000001 (ops 1-15)
I20260319 16:36:13.832849 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 11 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:13.832931 23986 raft_consensus.cc:2368] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 11. Current term is 12.
I20260319 16:36:13.832919 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 11 candidate_status { last_received { term: 10 index: 20 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:13.833185 23876 leader_election.cc:400] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 11 election: Vote denied by peer d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775) with higher term. Message: Invalid argument: T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 11. Current term is 12.
I20260319 16:36:13.833240 23876 leader_election.cc:403] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260319 16:36:13.833310 23293 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260319 16:36:13.833343 24154 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 11 FOLLOWER]: Advancing to term 12
I20260319 16:36:13.833370 23293 master.cc:561] Master@127.22.191.126:44511 shutting down...
I20260319 16:36:13.834790 24154 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775) with higher term. Message: Invalid argument: T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7563fd6ee62f4413ba4e70ef0a29be20 for earlier term 11. Current term is 12.
I20260319 16:36:13.917158 23986 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Refusing update from remote peer 462e25def85f4f0cb068219037b32bc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 20. Preceding OpId from leader: term: 12 index: 21. (index mismatch)
I20260319 16:36:13.917511 24153 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260319 16:36:13.918840 24012 heartbeater.cc:646] Failed to heartbeat to 127.22.191.126:44511 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20260319 16:36:13.919368 23908 raft_consensus.cc:1275] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 12 FOLLOWER]: Refusing update from remote peer 462e25def85f4f0cb068219037b32bc2: Log matching property violated. Preceding OpId in replica: term: 10 index: 20. Preceding OpId from leader: term: 12 index: 21. (index mismatch)
I20260319 16:36:13.919552 24153 consensus_queue.cc:1048] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260319 16:36:14.005154 23293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:14.005295 23293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.005318 23293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8a55a0c371bf4c0dabdbeb74ac0cd5f7: stopping tablet replica
I20260319 16:36:14.017954 23293 master.cc:583] Master@127.22.191.126:44511 shutdown complete.
I20260319 16:36:14.020102 23293 tablet_server.cc:178] TabletServer@127.22.191.65:0 shutting down...
I20260319 16:36:14.020916 24112 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 462e25def85f4f0cb068219037b32bc2)
I20260319 16:36:14.020993 24112 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:36:14.022132 24112 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.022256 24112 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 13 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:14.022505 24147 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 462e25def85f4f0cb068219037b32bc2)
I20260319 16:36:14.022562 24147 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:36:14.022794 23986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 13 candidate_status { last_received { term: 12 index: 21 } } ignore_live_leader: false dest_uuid: "d33022cf348645d8899f0bdfd1f56269"
I20260319 16:36:14.023149 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" candidate_term: 13 candidate_status { last_received { term: 12 index: 21 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:14.023758 24147 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.023916 23986 raft_consensus.cc:2393] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7563fd6ee62f4413ba4e70ef0a29be20 in current term 13: Already voted for candidate d33022cf348645d8899f0bdfd1f56269 in this term.
I20260319 16:36:14.023942 24147 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 13 election: Requested vote from peers 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
I20260319 16:36:14.024226 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b20fa20df0c46e184bd9bba694b8ee2" candidate_uuid: "d33022cf348645d8899f0bdfd1f56269" candidate_term: 13 candidate_status { last_received { term: 12 index: 21 } } ignore_live_leader: false dest_uuid: "462e25def85f4f0cb068219037b32bc2"
I20260319 16:36:14.024226 23876 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20; no voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:14.024416 24112 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260319 16:36:14.024914 23950 leader_election.cc:336] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260319 16:36:14.025013 23950 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d33022cf348645d8899f0bdfd1f56269; no voters: 462e25def85f4f0cb068219037b32bc2, 7563fd6ee62f4413ba4e70ef0a29be20
I20260319 16:36:14.025121 24147 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260319 16:36:14.033638 24025 consensus_peers.cc:597] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 -> Peer 7563fd6ee62f4413ba4e70ef0a29be20 (127.22.191.65:44565): Couldn't send request to peer 7563fd6ee62f4413ba4e70ef0a29be20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260319 16:36:14.043160 23986 raft_consensus.cc:1240] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Rejecting Update request from peer 462e25def85f4f0cb068219037b32bc2 for earlier term 12. Current term is 13. Ops: []
I20260319 16:36:14.043520 24156 consensus_queue.cc:1059] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 }, Status: INVALID_TERM, Last received: 12.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260319 16:36:14.043658 24156 raft_consensus.cc:3055] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 LEADER]: Stepping down as leader of term 12
I20260319 16:36:14.043675 24156 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 462e25def85f4f0cb068219037b32bc2, State: Running, Role: LEADER
I20260319 16:36:14.043824 24156 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 12.21, Last appended by leader: 21, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.043937 24156 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 12 FOLLOWER]: Advancing to term 13
I20260319 16:36:14.083437 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:14.083650 23293 tablet_replica.cc:333] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: stopping tablet replica
I20260319 16:36:14.083803 23293 raft_consensus.cc:2243] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:14.083875 23293 raft_consensus.cc:2272] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.096354 23293 tablet_server.cc:195] TabletServer@127.22.191.65:0 shutdown complete.
I20260319 16:36:14.097679 23293 tablet_server.cc:178] TabletServer@127.22.191.66:0 shutting down...
I20260319 16:36:14.114897 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:14.115132 23293 tablet_replica.cc:333] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269: stopping tablet replica
I20260319 16:36:14.115190 23293 raft_consensus.cc:2243] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:14.115248 23293 raft_consensus.cc:2272] T 3b20fa20df0c46e184bd9bba694b8ee2 P d33022cf348645d8899f0bdfd1f56269 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.117506 23293 tablet_server.cc:195] TabletServer@127.22.191.66:0 shutdown complete.
I20260319 16:36:14.118444 23293 tablet_server.cc:178] TabletServer@127.22.191.67:0 shutting down...
I20260319 16:36:14.145347 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:14.145546 23293 tablet_replica.cc:333] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2: stopping tablet replica
I20260319 16:36:14.145608 23293 raft_consensus.cc:2243] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:14.145658 23293 raft_consensus.cc:2272] T 3b20fa20df0c46e184bd9bba694b8ee2 P 462e25def85f4f0cb068219037b32bc2 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.158089 23293 tablet_server.cc:195] TabletServer@127.22.191.67:0 shutdown complete.
I20260319 16:36:14.159116 23293 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260319 16:36:14.159264 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260319 16:36:14.159371 23293 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260319 16:36:14.160733 24162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.160921 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:14.161062 24159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.161173 24160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.161324 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:14.161360 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:14.161372 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938174161372 us; error 0 us; skew 500 ppm
I20260319 16:36:14.161974 23293 webserver.cc:492] Webserver started at http://127.22.191.65:39109/ using document root <none> and password file <none>
I20260319 16:36:14.162063 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:14.162086 23293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260319 16:36:14.162729 23293 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260319 16:36:14.164179 24170 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.164351 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:14.164412 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "7563fd6ee62f4413ba4e70ef0a29be20"
format_stamp: "Formatted at 2026-03-19 16:36:11 on dist-test-slave-qk5m"
I20260319 16:36:14.164456 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5275
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:14.172533 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:14.172734 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:14.172880 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:14.173221 24177 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260319 16:36:14.174121 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260319 16:36:14.174175 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:14.174201 23293 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260319 16:36:14.174635 23293 ts_tablet_manager.cc:616] Registered 1 tablets
I20260319 16:36:14.174666 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.174731 24177 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Bootstrap starting.
I20260319 16:36:14.176393 24177 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260319 16:36:14.176654 24177 tablet_bootstrap.cc:492] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Bootstrap complete.
I20260319 16:36:14.176767 24177 ts_tablet_manager.cc:1403] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260319 16:36:14.176899 24177 raft_consensus.cc:359] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.177039 24177 raft_consensus.cc:740] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7563fd6ee62f4413ba4e70ef0a29be20, State: Initialized, Role: FOLLOWER
I20260319 16:36:14.177124 24177 consensus_queue.cc:260] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 21, Last appended: 12.21, Last appended by leader: 21, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.177294 24177 ts_tablet_manager.cc:1434] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260319 16:36:14.178148 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:44565
I20260319 16:36:14.180440 24236 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:44565 every 8 connection(s)
W20260319 16:36:14.181463 24237 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260319 16:36:14.188935 23293 tablet_server.cc:178] TabletServer@127.22.191.65:44565 shutting down...
I20260319 16:36:14.280753 24220 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:14.280957 24220 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 13 FOLLOWER]: Advancing to term 14
I20260319 16:36:14.281680 24220 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.281880 24220 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 14 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
W20260319 16:36:14.283041 24174 leader_election.cc:336] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775): Network error: Client connection negotiation failed: client connection to 127.22.191.66:40775: connect: Connection refused (error 111)
W20260319 16:36:14.283139 24174 leader_election.cc:336] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269): Network error: Client connection negotiation failed: client connection to 127.22.191.67:33269: connect: Connection refused (error 111)
I20260319 16:36:14.283156 24174 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20; no voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:14.283308 24220 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260319 16:36:14.400134 24220 raft_consensus.cc:493] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:14.400297 24220 raft_consensus.cc:3060] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 14 FOLLOWER]: Advancing to term 15
I20260319 16:36:14.401087 24220 raft_consensus.cc:515] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7563fd6ee62f4413ba4e70ef0a29be20" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 44565 } } peers { permanent_uuid: "d33022cf348645d8899f0bdfd1f56269" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 40775 } } peers { permanent_uuid: "462e25def85f4f0cb068219037b32bc2" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 33269 } }
I20260319 16:36:14.401268 24220 leader_election.cc:290] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 15 election: Requested vote from peers d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775), 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269)
W20260319 16:36:14.402176 24174 leader_election.cc:336] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer d33022cf348645d8899f0bdfd1f56269 (127.22.191.66:40775): Network error: Client connection negotiation failed: client connection to 127.22.191.66:40775: connect: Connection refused (error 111)
W20260319 16:36:14.402304 24174 leader_election.cc:336] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 462e25def85f4f0cb068219037b32bc2 (127.22.191.67:33269): Network error: Client connection negotiation failed: client connection to 127.22.191.67:33269: connect: Connection refused (error 111)
I20260319 16:36:14.402336 24174 leader_election.cc:304] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7563fd6ee62f4413ba4e70ef0a29be20; no voters: 462e25def85f4f0cb068219037b32bc2, d33022cf348645d8899f0bdfd1f56269
I20260319 16:36:14.402431 24220 raft_consensus.cc:2749] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260319 16:36:14.431224 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:14.431905 23293 tablet_replica.cc:333] stopping tablet replica
I20260319 16:36:14.432147 23293 raft_consensus.cc:2243] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:14.432224 23293 raft_consensus.cc:2272] T 3b20fa20df0c46e184bd9bba694b8ee2 P 7563fd6ee62f4413ba4e70ef0a29be20 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.446997 23293 tablet_server.cc:195] TabletServer@127.22.191.65:44565 shutdown complete.
[ OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (2964 ms)
[ RUN ] TimestampAdvancementITest.Kudu2463Test
I20260319 16:36:14.452495 23293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.191.126:42371
I20260319 16:36:14.452804 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:14.454486 24244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.454512 24247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.454540 24245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.454985 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:14.455118 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:14.455152 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:14.455168 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938174455169 us; error 0 us; skew 500 ppm
I20260319 16:36:14.455813 23293 webserver.cc:492] Webserver started at http://127.22.191.126:36333/ using document root <none> and password file <none>
I20260319 16:36:14.455906 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:14.455956 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:14.456009 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:14.456337 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/master-0-root/instance:
uuid: "a2ff136f5f03479983a7789827b4ff90"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.457222 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:14.457681 24252 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.457798 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.457844 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/master-0-root
uuid: "a2ff136f5f03479983a7789827b4ff90"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.457893 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:14.471098 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:14.471330 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:14.473949 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.126:42371
I20260319 16:36:14.474545 24304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.126:42371 every 8 connection(s)
I20260319 16:36:14.474639 24305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:14.475680 24305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90: Bootstrap starting.
I20260319 16:36:14.475997 24305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:14.476531 24305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90: No bootstrap required, opened a new log
I20260319 16:36:14.476660 24305 raft_consensus.cc:359] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER }
I20260319 16:36:14.476713 24305 raft_consensus.cc:385] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:14.476732 24305 raft_consensus.cc:740] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2ff136f5f03479983a7789827b4ff90, State: Initialized, Role: FOLLOWER
I20260319 16:36:14.476779 24305 consensus_queue.cc:260] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER }
I20260319 16:36:14.476810 24305 raft_consensus.cc:399] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:14.476830 24305 raft_consensus.cc:493] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:14.476856 24305 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:14.477356 24305 raft_consensus.cc:515] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER }
I20260319 16:36:14.477413 24305 leader_election.cc:304] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a2ff136f5f03479983a7789827b4ff90; no voters:
I20260319 16:36:14.477523 24305 leader_election.cc:290] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260319 16:36:14.477579 24308 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:14.477684 24305 sys_catalog.cc:565] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [sys.catalog]: configured and running, proceeding with master startup.
I20260319 16:36:14.477684 24308 raft_consensus.cc:697] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 1 LEADER]: Becoming Leader. State: Replica: a2ff136f5f03479983a7789827b4ff90, State: Running, Role: LEADER
I20260319 16:36:14.477798 24308 consensus_queue.cc:237] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER }
I20260319 16:36:14.478029 24309 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a2ff136f5f03479983a7789827b4ff90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER } }
I20260319 16:36:14.478055 24310 sys_catalog.cc:455] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a2ff136f5f03479983a7789827b4ff90. Latest consensus state: current_term: 1 leader_uuid: "a2ff136f5f03479983a7789827b4ff90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a2ff136f5f03479983a7789827b4ff90" member_type: VOTER } }
I20260319 16:36:14.478312 24310 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:14.478241 24309 sys_catalog.cc:458] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:14.478518 24318 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260319 16:36:14.478655 24318 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260319 16:36:14.479008 23293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260319 16:36:14.479223 24318 catalog_manager.cc:1357] Generated new cluster ID: bc0116fc0ce7452b97d3557f69bd39ce
I20260319 16:36:14.479274 24318 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260319 16:36:14.493433 24318 catalog_manager.cc:1380] Generated new certificate authority record
I20260319 16:36:14.493919 24318 catalog_manager.cc:1514] Loading token signing keys...
I20260319 16:36:14.502173 24318 catalog_manager.cc:6044] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90: Generated new TSK 0
I20260319 16:36:14.502291 24318 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260319 16:36:14.511164 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:14.513141 24329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.513142 24326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.513145 24327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.513489 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:14.513747 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:14.513856 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:14.513881 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938174513881 us; error 0 us; skew 500 ppm
I20260319 16:36:14.514763 23293 webserver.cc:492] Webserver started at http://127.22.191.65:43725/ using document root <none> and password file <none>
I20260319 16:36:14.514861 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:14.514909 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:14.514966 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:14.515321 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root/instance:
uuid: "4ce8535887694682a6f7906757c8e655"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.516494 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:14.517287 24334 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.517520 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:14.517582 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "4ce8535887694682a6f7906757c8e655"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.517648 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:14.527485 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:14.527740 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:14.527908 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:14.528095 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:14.528121 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.528151 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:14.528174 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.531381 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:37703
I20260319 16:36:14.531381 24397 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:37703 every 8 connection(s)
I20260319 16:36:14.531947 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:14.533535 24405 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.533623 24402 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.533541 24403 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.534196 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:14.534359 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:14.534418 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:14.534436 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938174534437 us; error 0 us; skew 500 ppm
I20260319 16:36:14.535290 23293 webserver.cc:492] Webserver started at http://127.22.191.66:45467/ using document root <none> and password file <none>
I20260319 16:36:14.535398 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:14.535451 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:14.535507 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:14.535934 24398 heartbeater.cc:344] Connected to a master server at 127.22.191.126:42371
I20260319 16:36:14.536008 24398 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:14.535959 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-1-root/instance:
uuid: "70c2cb99acbf412c9c58d59905833b27"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.536118 24398 heartbeater.cc:507] Master 127.22.191.126:42371 requested a full tablet report, sending...
I20260319 16:36:14.536454 24269 ts_manager.cc:194] Registered new tserver with Master: 4ce8535887694682a6f7906757c8e655 (127.22.191.65:37703)
I20260319 16:36:14.536998 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:14.537319 24269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46814
I20260319 16:36:14.537700 24410 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.537946 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:14.537998 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-1-root
uuid: "70c2cb99acbf412c9c58d59905833b27"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.538086 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:14.556450 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:14.556706 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:14.556860 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:14.557034 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:14.557067 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.557089 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:14.557106 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.560117 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.66:38411
I20260319 16:36:14.560214 24473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.66:38411 every 8 connection(s)
I20260319 16:36:14.560529 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:14.562321 24477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.562606 24478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:14.562690 24480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:14.563292 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:14.563441 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:14.563475 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:14.563493 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938174563493 us; error 0 us; skew 500 ppm
I20260319 16:36:14.564622 23293 webserver.cc:492] Webserver started at http://127.22.191.67:41781/ using document root <none> and password file <none>
I20260319 16:36:14.564626 24474 heartbeater.cc:344] Connected to a master server at 127.22.191.126:42371
I20260319 16:36:14.564742 24474 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:14.564738 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:14.564889 24474 heartbeater.cc:507] Master 127.22.191.126:42371 requested a full tablet report, sending...
I20260319 16:36:14.564898 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:14.564994 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:14.565222 24269 ts_manager.cc:194] Registered new tserver with Master: 70c2cb99acbf412c9c58d59905833b27 (127.22.191.66:38411)
I20260319 16:36:14.565297 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-2-root/instance:
uuid: "6ca789ab6646455088f48cbe4f993755"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.565622 24269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46822
I20260319 16:36:14.566325 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:14.566995 24485 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.567176 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:14.567235 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-2-root
uuid: "6ca789ab6646455088f48cbe4f993755"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:14.567274 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:14.571599 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:14.571875 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:14.572059 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:14.572304 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:14.572338 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.572367 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:14.572392 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.575623 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.67:39959
I20260319 16:36:14.575841 24548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.67:39959 every 8 connection(s)
I20260319 16:36:14.579142 24549 heartbeater.cc:344] Connected to a master server at 127.22.191.126:42371
I20260319 16:36:14.579211 24549 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:14.579308 24549 heartbeater.cc:507] Master 127.22.191.126:42371 requested a full tablet report, sending...
I20260319 16:36:14.579581 24269 ts_manager.cc:194] Registered new tserver with Master: 6ca789ab6646455088f48cbe4f993755 (127.22.191.67:39959)
I20260319 16:36:14.580101 24269 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46828
I20260319 16:36:14.580317 23293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004522101s
I20260319 16:36:14.596066 24269 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46864:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260319 16:36:14.596225 24269 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260319 16:36:14.601699 24438 tablet_service.cc:1511] Processing CreateTablet for tablet f6de3fa089214cce91b9b8069bc08982 (DEFAULT_TABLE table=test-workload [id=3531bb806e5c481f853d044a297f42f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:14.601713 24362 tablet_service.cc:1511] Processing CreateTablet for tablet f6de3fa089214cce91b9b8069bc08982 (DEFAULT_TABLE table=test-workload [id=3531bb806e5c481f853d044a297f42f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:14.601840 24513 tablet_service.cc:1511] Processing CreateTablet for tablet f6de3fa089214cce91b9b8069bc08982 (DEFAULT_TABLE table=test-workload [id=3531bb806e5c481f853d044a297f42f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:14.601874 24438 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de3fa089214cce91b9b8069bc08982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:14.601958 24513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de3fa089214cce91b9b8069bc08982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:14.601876 24362 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6de3fa089214cce91b9b8069bc08982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:14.603438 24570 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: Bootstrap starting.
I20260319 16:36:14.603612 24571 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: Bootstrap starting.
I20260319 16:36:14.603976 24570 tablet_bootstrap.cc:654] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:14.604023 24571 tablet_bootstrap.cc:654] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:14.604362 24572 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Bootstrap starting.
I20260319 16:36:14.604629 24571 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: No bootstrap required, opened a new log
I20260319 16:36:14.604666 24571 ts_tablet_manager.cc:1403] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:14.604827 24571 raft_consensus.cc:359] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.604900 24571 raft_consensus.cc:385] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:14.604918 24571 raft_consensus.cc:740] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70c2cb99acbf412c9c58d59905833b27, State: Initialized, Role: FOLLOWER
I20260319 16:36:14.604967 24572 tablet_bootstrap.cc:654] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:14.604971 24570 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: No bootstrap required, opened a new log
I20260319 16:36:14.605042 24570 ts_tablet_manager.cc:1403] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260319 16:36:14.605028 24571 consensus_queue.cc:260] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.605206 24571 ts_tablet_manager.cc:1434] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:14.605261 24474 heartbeater.cc:499] Master 127.22.191.126:42371 was elected leader, sending a full tablet report...
I20260319 16:36:14.605202 24570 raft_consensus.cc:359] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.605329 24570 raft_consensus.cc:385] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:14.605346 24570 raft_consensus.cc:740] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca789ab6646455088f48cbe4f993755, State: Initialized, Role: FOLLOWER
I20260319 16:36:14.605412 24570 consensus_queue.cc:260] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.605557 24570 ts_tablet_manager.cc:1434] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:14.605610 24549 heartbeater.cc:499] Master 127.22.191.126:42371 was elected leader, sending a full tablet report...
I20260319 16:36:14.606058 24572 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: No bootstrap required, opened a new log
I20260319 16:36:14.606117 24572 ts_tablet_manager.cc:1403] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260319 16:36:14.606323 24572 raft_consensus.cc:359] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.606408 24572 raft_consensus.cc:385] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:14.606429 24572 raft_consensus.cc:740] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce8535887694682a6f7906757c8e655, State: Initialized, Role: FOLLOWER
I20260319 16:36:14.606483 24572 consensus_queue.cc:260] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.606725 24572 ts_tablet_manager.cc:1434] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:14.606736 24398 heartbeater.cc:499] Master 127.22.191.126:42371 was elected leader, sending a full tablet report...
I20260319 16:36:14.649169 24578 raft_consensus.cc:493] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260319 16:36:14.649286 24578 raft_consensus.cc:515] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.649482 24578 leader_election.cc:290] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 70c2cb99acbf412c9c58d59905833b27 (127.22.191.66:38411), 6ca789ab6646455088f48cbe4f993755 (127.22.191.67:39959)
I20260319 16:36:14.652598 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de3fa089214cce91b9b8069bc08982" candidate_uuid: "4ce8535887694682a6f7906757c8e655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca789ab6646455088f48cbe4f993755" is_pre_election: true
I20260319 16:36:14.652755 24523 raft_consensus.cc:2468] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce8535887694682a6f7906757c8e655 in term 0.
I20260319 16:36:14.652949 24338 leader_election.cc:304] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ce8535887694682a6f7906757c8e655, 6ca789ab6646455088f48cbe4f993755; no voters:
I20260319 16:36:14.653129 24578 raft_consensus.cc:2804] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260319 16:36:14.653177 24578 raft_consensus.cc:493] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260319 16:36:14.653196 24578 raft_consensus.cc:3060] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:14.653288 24448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de3fa089214cce91b9b8069bc08982" candidate_uuid: "4ce8535887694682a6f7906757c8e655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c2cb99acbf412c9c58d59905833b27" is_pre_election: true
I20260319 16:36:14.653355 24448 raft_consensus.cc:2468] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce8535887694682a6f7906757c8e655 in term 0.
I20260319 16:36:14.653913 24578 raft_consensus.cc:515] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.654049 24578 leader_election.cc:290] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [CANDIDATE]: Term 1 election: Requested vote from peers 70c2cb99acbf412c9c58d59905833b27 (127.22.191.66:38411), 6ca789ab6646455088f48cbe4f993755 (127.22.191.67:39959)
I20260319 16:36:14.654201 24523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de3fa089214cce91b9b8069bc08982" candidate_uuid: "4ce8535887694682a6f7906757c8e655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ca789ab6646455088f48cbe4f993755"
I20260319 16:36:14.654233 24448 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6de3fa089214cce91b9b8069bc08982" candidate_uuid: "4ce8535887694682a6f7906757c8e655" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70c2cb99acbf412c9c58d59905833b27"
I20260319 16:36:14.654270 24523 raft_consensus.cc:3060] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:14.654286 24448 raft_consensus.cc:3060] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:14.654961 24448 raft_consensus.cc:2468] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce8535887694682a6f7906757c8e655 in term 1.
I20260319 16:36:14.654987 24523 raft_consensus.cc:2468] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce8535887694682a6f7906757c8e655 in term 1.
I20260319 16:36:14.655226 24338 leader_election.cc:304] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ce8535887694682a6f7906757c8e655, 6ca789ab6646455088f48cbe4f993755; no voters:
I20260319 16:36:14.655330 24578 raft_consensus.cc:2804] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:14.655485 24578 raft_consensus.cc:697] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Becoming Leader. State: Replica: 4ce8535887694682a6f7906757c8e655, State: Running, Role: LEADER
I20260319 16:36:14.655534 24578 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.656179 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ce8535887694682a6f7906757c8e655 (127.22.191.65). New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.662823 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260319 16:36:14.662859 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260319 16:36:14.663163 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:36:14.663336 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260319 16:36:14.687249 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.687695 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260319 16:36:14.687847 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260319 16:36:14.687996 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:14.688122 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260319 16:36:14.689100 24580 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.689261 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.690464 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.690629 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index -1 to 17, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.691745 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
W20260319 16:36:14.692054 24267 catalog_manager.cc:5349] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 17: no extra replica candidate found for tablet f6de3fa089214cce91b9b8069bc08982 (table test-workload [id=3531bb806e5c481f853d044a297f42f2]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260319 16:36:14.692482 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260319 16:36:14.692622 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260319 16:36:14.692698 24578 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:14.693181 24578 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260319 16:36:14.693753 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.694041 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.695201 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 17 to 18, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.695338 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.695847 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.696141 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260319 16:36:14.696416 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:14.697082 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260319 16:36:14.697402 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260319 16:36:14.698081 24578 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.698308 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.699092 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.699420 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 18 to 19, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.699483 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.700019 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260319 16:36:14.700320 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260319 16:36:14.700515 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260319 16:36:14.700614 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260319 16:36:14.701678 24578 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.701964 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.701974 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.703382 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 reported cstate change: config changed from index 19 to 20, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.703625 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.704056 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260319 16:36:14.704282 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260319 16:36:14.704458 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260319 16:36:14.704576 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260319 16:36:14.705099 24580 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.705227 24446 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.706135 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.706207 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 20 to 21, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.706624 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.707108 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260319 16:36:14.707265 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260319 16:36:14.707271 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260319 16:36:14.707518 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260319 16:36:14.708045 24578 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.708115 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.708132 24446 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.709157 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 21 to 22, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.709256 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.709628 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260319 16:36:14.709643 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260319 16:36:14.709805 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260319 16:36:14.710047 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260319 16:36:14.710316 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.710418 24446 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.710752 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.711360 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 22 to 23, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.711738 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.712109 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260319 16:36:14.712124 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260319 16:36:14.712357 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260319 16:36:14.712455 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260319 16:36:14.712889 24580 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.713124 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.713819 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 23 to 24, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.713889 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.714190 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260319 16:36:14.714352 24446 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.714493 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260319 16:36:14.715342 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260319 16:36:14.715596 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260319 16:36:14.716279 24578 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.716354 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.717332 24269 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 24 to 25, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.717469 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.717906 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260319 16:36:14.717664 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.718058 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260319 16:36:14.718665 24578 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.718825 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260319 16:36:14.719256 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260319 16:36:14.719691 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.720093 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 25 to 26, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.720196 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.720584 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.720890 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260319 16:36:14.721159 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260319 16:36:14.721475 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260319 16:36:14.721711 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260319 16:36:14.722249 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.722374 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.723029 24523 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.723271 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.723316 24269 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 26 to 27, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.723668 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260319 16:36:14.723923 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260319 16:36:14.724131 24606 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260319 16:36:14.724292 24606 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260319 16:36:14.724807 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.724918 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.724928 24522 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.726121 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 27 to 28, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.726423 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.726756 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260319 16:36:14.726851 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260319 16:36:14.726994 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260319 16:36:14.727103 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260319 16:36:14.727579 24580 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.727669 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.728550 24522 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.728591 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 28 to 29, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.729699 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.730104 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260319 16:36:14.730104 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260319 16:36:14.730320 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260319 16:36:14.730400 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260319 16:36:14.730898 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.731005 24522 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.731150 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.731886 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 reported cstate change: config changed from index 29 to 30, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.732023 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.732419 24522 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260319 16:36:14.732604 24606 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260319 16:36:14.732435 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260319 16:36:14.733042 24606 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260319 16:36:14.733623 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.733719 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.734977 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.735028 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 30 to 31, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.735478 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260319 16:36:14.735694 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260319 16:36:14.736114 24523 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260319 16:36:14.736248 24522 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.736287 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 30, Time since last communication: 0.000s
I20260319 16:36:14.736467 24588 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.736646 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.737494 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 reported cstate change: config changed from index 31 to 32, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:14.738031 24521 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.738096 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.739511 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260319 16:36:14.739668 24521 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260319 16:36:14.739820 24606 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260319 16:36:14.740068 24605 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260319 16:36:14.740162 24254 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 25: aborting the task: latest config opid_index 32; task opid_index 25
I20260319 16:36:14.740893 24606 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.741037 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.741855 24267 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 32 to 33, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.742022 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.742355 24521 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.742636 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260319 16:36:14.742921 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260319 16:36:14.743347 24521 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260319 16:36:14.743484 24605 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.743520 24580 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260319 16:36:14.743686 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.743860 24521 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.744778 24269 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 reported cstate change: config changed from index 33 to 34, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.744959 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.745360 24448 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260319 16:36:14.745532 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260319 16:36:14.745688 24521 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260319 16:36:14.745862 24588 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260319 16:36:14.746193 24605 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.746423 24521 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.747181 24448 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.747305 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 reported cstate change: config changed from index 34 to 35, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: NON_VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.747469 24372 consensus_queue.cc:237] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:14.748396 24446 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260319 16:36:14.748407 24521 raft_consensus.cc:1275] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 LEARNER]: Refusing update from remote peer 4ce8535887694682a6f7906757c8e655: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260319 16:36:14.748611 24578 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260319 16:36:14.748862 24578 consensus_queue.cc:1048] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260319 16:36:14.748937 24254 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 23: aborting the task: latest config opid_index 35; task opid_index 23
I20260319 16:36:14.749424 24605 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.749519 24446 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.749583 24521 raft_consensus.cc:2955] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.750404 24268 catalog_manager.cc:5671] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 reported cstate change: config changed from index 35 to 36, 6ca789ab6646455088f48cbe4f993755 (127.22.191.67) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4ce8535887694682a6f7906757c8e655" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } } }
I20260319 16:36:14.750845 23293 timestamp_advancement-itest.cc:267] GCing logs...
I20260319 16:36:14.750916 23293 log_reader.cc:385] T f6de3fa089214cce91b9b8069bc08982: removed 1 log segments from log reader
I20260319 16:36:14.751008 23293 log.cc:1079] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Deleting log segment in path: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root/wals/f6de3fa089214cce91b9b8069bc08982/wal-000000001 (ops 1-16)
I20260319 16:36:14.751658 23293 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260319 16:36:14.751708 23293 master.cc:561] Master@127.22.191.126:42371 shutting down...
I20260319 16:36:14.754174 24255 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 19: aborting the task: latest config opid_index 36; task opid_index 19
I20260319 16:36:14.756057 24256 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 17: aborting the task: latest config opid_index 36; task opid_index 17
I20260319 16:36:14.764384 24254 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 21: aborting the task: latest config opid_index 36; task opid_index 21
I20260319 16:36:14.766528 24255 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 35: aborting the task: latest config opid_index 36; task opid_index 35
I20260319 16:36:14.767379 24256 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 27: aborting the task: latest config opid_index 36; task opid_index 27
I20260319 16:36:14.767832 24255 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 29: aborting the task: latest config opid_index 36; task opid_index 29
I20260319 16:36:14.774665 24254 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 33: aborting the task: latest config opid_index 36; task opid_index 33
I20260319 16:36:14.777053 24255 catalog_manager.cc:5218] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet f6de3fa089214cce91b9b8069bc08982 with cas_config_opid_index 31: aborting the task: latest config opid_index 36; task opid_index 31
I20260319 16:36:14.972463 23293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:14.972579 23293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:14.972671 23293 tablet_replica.cc:333] T 00000000000000000000000000000000 P a2ff136f5f03479983a7789827b4ff90: stopping tablet replica
I20260319 16:36:14.975301 23293 master.cc:583] Master@127.22.191.126:42371 shutdown complete.
I20260319 16:36:14.976879 23293 tablet_server.cc:178] TabletServer@127.22.191.65:0 shutting down...
I20260319 16:36:15.032475 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:15.032711 23293 tablet_replica.cc:333] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: stopping tablet replica
I20260319 16:36:15.032768 23293 raft_consensus.cc:2243] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:15.032858 23293 raft_consensus.cc:2272] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.046254 23293 tablet_server.cc:195] TabletServer@127.22.191.65:0 shutdown complete.
I20260319 16:36:15.047737 23293 tablet_server.cc:178] TabletServer@127.22.191.66:0 shutting down...
I20260319 16:36:15.061182 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:15.061440 23293 tablet_replica.cc:333] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27: stopping tablet replica
I20260319 16:36:15.061510 23293 raft_consensus.cc:2243] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:15.061584 23293 raft_consensus.cc:2272] T f6de3fa089214cce91b9b8069bc08982 P 70c2cb99acbf412c9c58d59905833b27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.074250 23293 tablet_server.cc:195] TabletServer@127.22.191.66:0 shutdown complete.
I20260319 16:36:15.075511 23293 tablet_server.cc:178] TabletServer@127.22.191.67:0 shutting down...
I20260319 16:36:15.326809 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:15.326960 23293 tablet_replica.cc:333] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755: stopping tablet replica
I20260319 16:36:15.327025 23293 raft_consensus.cc:2243] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:15.327100 23293 raft_consensus.cc:2272] T f6de3fa089214cce91b9b8069bc08982 P 6ca789ab6646455088f48cbe4f993755 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.339696 23293 tablet_server.cc:195] TabletServer@127.22.191.67:0 shutdown complete.
I20260319 16:36:15.341228 23293 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260319 16:36:15.341421 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.343508 24607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.343518 24610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.343617 24608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.344208 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:15.344334 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.344370 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.344385 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175344386 us; error 0 us; skew 500 ppm
I20260319 16:36:15.345168 23293 webserver.cc:492] Webserver started at http://127.22.191.65:43725/ using document root <none> and password file <none>
I20260319 16:36:15.345260 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.345297 23293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260319 16:36:15.346271 23293 fs_manager.cc:714] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:15.347842 24617 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.348170 23293 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260319 16:36:15.348234 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "4ce8535887694682a6f7906757c8e655"
format_stamp: "Formatted at 2026-03-19 16:36:14 on dist-test-slave-qk5m"
I20260319 16:36:15.348320 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5293
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.378131 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.378352 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.378527 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:15.378863 24624 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260319 16:36:15.379485 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260319 16:36:15.379554 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:15.379590 23293 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260319 16:36:15.380096 23293 ts_tablet_manager.cc:616] Registered 1 tablets
I20260319 16:36:15.380131 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:15.380175 24624 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Bootstrap starting.
I20260319 16:36:15.382903 24624 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260319 16:36:15.383237 24624 tablet_bootstrap.cc:492] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Bootstrap complete.
I20260319 16:36:15.383368 24624 ts_tablet_manager.cc:1403] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260319 16:36:15.383515 24624 raft_consensus.cc:359] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:15.383592 24624 raft_consensus.cc:740] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce8535887694682a6f7906757c8e655, State: Initialized, Role: FOLLOWER
I20260319 16:36:15.383652 24624 consensus_queue.cc:260] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 1.36, Last appended by leader: 36, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "70c2cb99acbf412c9c58d59905833b27" member_type: VOTER last_known_addr { host: "127.22.191.66" port: 38411 } } peers { permanent_uuid: "6ca789ab6646455088f48cbe4f993755" member_type: VOTER last_known_addr { host: "127.22.191.67" port: 39959 } } peers { permanent_uuid: "4ce8535887694682a6f7906757c8e655" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 37703 } }
I20260319 16:36:15.383793 24624 ts_tablet_manager.cc:1434] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.384207 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:37703
I20260319 16:36:15.386667 24683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:37703 every 8 connection(s)
W20260319 16:36:15.388034 24684 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260319 16:36:15.394948 24637 tablet_service.cc:3018] Rejecting scan request for tablet f6de3fa089214cce91b9b8069bc08982: Uninitialized: clean time has not yet been initialized
I20260319 16:36:15.395421 23293 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260319 16:36:15.395581 23293 tablet_server.cc:178] TabletServer@127.22.191.65:37703 shutting down...
I20260319 16:36:15.637511 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:15.637837 23293 tablet_replica.cc:333] stopping tablet replica
I20260319 16:36:15.638055 23293 raft_consensus.cc:2243] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260319 16:36:15.638243 23293 raft_consensus.cc:2272] T f6de3fa089214cce91b9b8069bc08982 P 4ce8535887694682a6f7906757c8e655 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.650552 23293 tablet_server.cc:195] TabletServer@127.22.191.65:37703 shutdown complete.
[ OK ] TimestampAdvancementITest.Kudu2463Test (1202 ms)
[ RUN ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260319 16:36:15.655089 23293 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260319 16:36:15.655241 23293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.191.126:32925
I20260319 16:36:15.655436 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.657148 24690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.657168 24692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.657366 24689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.657418 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:15.657539 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.657570 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.657583 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175657584 us; error 0 us; skew 500 ppm
I20260319 16:36:15.658216 23293 webserver.cc:492] Webserver started at http://127.22.191.126:33477/ using document root <none> and password file <none>
I20260319 16:36:15.658310 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.658357 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:15.658402 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:15.658672 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root/instance:
uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.659687 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:15.660344 24697 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.660548 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:15.660593 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.660645 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.666525 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.666777 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.670619 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.126:32925
I20260319 16:36:15.671286 24749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.126:32925 every 8 connection(s)
I20260319 16:36:15.671463 24750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:15.672685 24750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Bootstrap starting.
I20260319 16:36:15.672981 24750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:15.673663 24750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: No bootstrap required, opened a new log
I20260319 16:36:15.673890 24750 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.673956 24750 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:15.673974 24750 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee5da8ba6e04456aea3a1c2b131f6d1, State: Initialized, Role: FOLLOWER
I20260319 16:36:15.674026 24750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.674067 24750 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:15.674085 24750 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:15.674111 24750 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:15.674636 24750 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.674696 24750 leader_election.cc:304] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ee5da8ba6e04456aea3a1c2b131f6d1; no voters:
I20260319 16:36:15.674824 24750 leader_election.cc:290] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260319 16:36:15.674883 24753 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:15.674988 24750 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260319 16:36:15.674978 24753 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 LEADER]: Becoming Leader. State: Replica: 0ee5da8ba6e04456aea3a1c2b131f6d1, State: Running, Role: LEADER
I20260319 16:36:15.675077 24753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.675289 24754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER } }
I20260319 16:36:15.675343 24754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:15.675315 24755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ee5da8ba6e04456aea3a1c2b131f6d1. Latest consensus state: current_term: 1 leader_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER } }
I20260319 16:36:15.675393 24755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:15.675482 24757 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260319 16:36:15.675659 24757 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260319 16:36:15.676319 23293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260319 16:36:15.676438 24757 catalog_manager.cc:1357] Generated new cluster ID: 3597e472d73340fb84a3efde1a97f862
I20260319 16:36:15.676497 24757 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260319 16:36:15.695397 24757 catalog_manager.cc:1380] Generated new certificate authority record
I20260319 16:36:15.696013 24757 catalog_manager.cc:1514] Loading token signing keys...
I20260319 16:36:15.699266 24757 catalog_manager.cc:6044] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Generated new TSK 0
I20260319 16:36:15.699384 24757 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260319 16:36:15.708536 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260319 16:36:15.710425 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:15.710953 24771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.711017 24772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.711177 24774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.711400 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.711445 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.711458 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175711459 us; error 0 us; skew 500 ppm
I20260319 16:36:15.712199 23293 webserver.cc:492] Webserver started at http://127.22.191.65:44943/ using document root <none> and password file <none>
I20260319 16:36:15.712312 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.712363 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:15.712414 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:15.712689 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root/instance:
uuid: "da8797ffecf84e808ca6fe4e2c66e534"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.713580 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:15.714179 24779 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.714342 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260319 16:36:15.714397 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "da8797ffecf84e808ca6fe4e2c66e534"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.714445 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.736876 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.737143 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.737308 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:15.737520 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:15.737548 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.737578 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:15.737598 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.740458 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:40505
I20260319 16:36:15.740495 24842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:40505 every 8 connection(s)
I20260319 16:36:15.744436 24843 heartbeater.cc:344] Connected to a master server at 127.22.191.126:32925
I20260319 16:36:15.744522 24843 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:15.744627 24843 heartbeater.cc:507] Master 127.22.191.126:32925 requested a full tablet report, sending...
I20260319 16:36:15.745124 24714 ts_manager.cc:194] Registered new tserver with Master: da8797ffecf84e808ca6fe4e2c66e534 (127.22.191.65:40505)
I20260319 16:36:15.745187 23293 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004533039s
I20260319 16:36:15.745959 24714 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41762
I20260319 16:36:15.760114 24714 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41776:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260319 16:36:15.765430 24807 tablet_service.cc:1511] Processing CreateTablet for tablet 4b4209f6779a48bea40f6a7023a5c3ec (DEFAULT_TABLE table=test-workload [id=9501f64655f74ee5882b216268986d6c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260319 16:36:15.765600 24807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4209f6779a48bea40f6a7023a5c3ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260319 16:36:15.766997 24861 tablet_bootstrap.cc:492] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Bootstrap starting.
I20260319 16:36:15.767351 24861 tablet_bootstrap.cc:654] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Neither blocks nor log segments found. Creating new log.
I20260319 16:36:15.768086 24861 tablet_bootstrap.cc:492] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: No bootstrap required, opened a new log
I20260319 16:36:15.768147 24861 ts_tablet_manager.cc:1403] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:15.768306 24861 raft_consensus.cc:359] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.768368 24861 raft_consensus.cc:385] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260319 16:36:15.768391 24861 raft_consensus.cc:740] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8797ffecf84e808ca6fe4e2c66e534, State: Initialized, Role: FOLLOWER
I20260319 16:36:15.768468 24861 consensus_queue.cc:260] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.768517 24861 raft_consensus.cc:399] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:15.768530 24861 raft_consensus.cc:493] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:15.768543 24861 raft_consensus.cc:3060] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 0 FOLLOWER]: Advancing to term 1
I20260319 16:36:15.769240 24861 raft_consensus.cc:515] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.769305 24861 leader_election.cc:304] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da8797ffecf84e808ca6fe4e2c66e534; no voters:
I20260319 16:36:15.769423 24861 leader_election.cc:290] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260319 16:36:15.769502 24863 raft_consensus.cc:2804] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Leader election won for term 1
I20260319 16:36:15.769555 24861 ts_tablet_manager.cc:1434] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260319 16:36:15.769582 24863 raft_consensus.cc:697] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 LEADER]: Becoming Leader. State: Replica: da8797ffecf84e808ca6fe4e2c66e534, State: Running, Role: LEADER
I20260319 16:36:15.769625 24843 heartbeater.cc:499] Master 127.22.191.126:32925 was elected leader, sending a full tablet report...
I20260319 16:36:15.769636 24863 consensus_queue.cc:237] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.770165 24714 catalog_manager.cc:5671] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 reported cstate change: term changed from 0 to 1, leader changed from <none> to da8797ffecf84e808ca6fe4e2c66e534 (127.22.191.65). New cstate: current_term: 1 leader_uuid: "da8797ffecf84e808ca6fe4e2c66e534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:15.772017 23293 tablet_server.cc:178] TabletServer@127.22.191.65:0 shutting down...
I20260319 16:36:15.775496 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:15.775910 23293 tablet_replica.cc:333] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: stopping tablet replica
I20260319 16:36:15.775964 23293 raft_consensus.cc:2243] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:15.776010 23293 raft_consensus.cc:2272] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.788515 23293 tablet_server.cc:195] TabletServer@127.22.191.65:0 shutdown complete.
I20260319 16:36:15.790328 23293 master.cc:561] Master@127.22.191.126:32925 shutting down...
I20260319 16:36:15.793642 23293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 LEADER]: Raft consensus shutting down.
I20260319 16:36:15.793751 23293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:15.793870 23293 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: stopping tablet replica
I20260319 16:36:15.806820 23293 master.cc:583] Master@127.22.191.126:32925 shutdown complete.
I20260319 16:36:15.809142 23293 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260319 16:36:15.809320 23293 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.191.126:41245
I20260319 16:36:15.809434 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.810904 24867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.811012 24870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.811143 24868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.811154 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:15.811305 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.811331 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.811347 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175811346 us; error 0 us; skew 500 ppm
I20260319 16:36:15.812037 23293 webserver.cc:492] Webserver started at http://127.22.191.126:42541/ using document root <none> and password file <none>
I20260319 16:36:15.812156 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.812194 23293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260319 16:36:15.812878 23293 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.813457 24875 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.813611 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260319 16:36:15.813660 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.813719 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.848079 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.848338 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.851001 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.126:41245
I20260319 16:36:15.851989 24927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.126:41245 every 8 connection(s)
I20260319 16:36:15.853209 24928 sys_catalog.cc:263] Verifying existing consensus state
I20260319 16:36:15.853626 24928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Bootstrap starting.
I20260319 16:36:15.855302 24928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260319 16:36:15.855543 24928 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Bootstrap complete.
I20260319 16:36:15.855757 24928 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.855825 24928 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ee5da8ba6e04456aea3a1c2b131f6d1, State: Initialized, Role: FOLLOWER
I20260319 16:36:15.855865 24928 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.855908 24928 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:15.855937 24928 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:15.855958 24928 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:36:15.856549 24928 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.856611 24928 leader_election.cc:304] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ee5da8ba6e04456aea3a1c2b131f6d1; no voters:
I20260319 16:36:15.856717 24928 leader_election.cc:290] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260319 16:36:15.856796 24931 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 2 FOLLOWER]: Leader election won for term 2
I20260319 16:36:15.856894 24928 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260319 16:36:15.856902 24931 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 2 LEADER]: Becoming Leader. State: Replica: 0ee5da8ba6e04456aea3a1c2b131f6d1, State: Running, Role: LEADER
I20260319 16:36:15.856977 24931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER }
I20260319 16:36:15.857178 24931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ee5da8ba6e04456aea3a1c2b131f6d1. Latest consensus state: current_term: 2 leader_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER } }
I20260319 16:36:15.857257 24932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ee5da8ba6e04456aea3a1c2b131f6d1" member_type: VOTER } }
I20260319 16:36:15.857338 24931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:15.857348 24932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [sys.catalog]: This master's current role is: LEADER
I20260319 16:36:15.857571 24937 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260319 16:36:15.857864 24937 catalog_manager.cc:679] Loaded metadata for table test-workload [id=9501f64655f74ee5882b216268986d6c]
I20260319 16:36:15.857993 24937 tablet_loader.cc:96] loaded metadata for tablet 4b4209f6779a48bea40f6a7023a5c3ec (table test-workload [id=9501f64655f74ee5882b216268986d6c])
I20260319 16:36:15.858038 24937 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260319 16:36:15.858150 24937 catalog_manager.cc:1269] Loaded cluster ID: 3597e472d73340fb84a3efde1a97f862
I20260319 16:36:15.858184 24937 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260319 16:36:15.858336 23293 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260319 16:36:15.859090 24937 catalog_manager.cc:1514] Loading token signing keys...
I20260319 16:36:15.859220 24937 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1: Loaded TSK: 0
I20260319 16:36:15.859325 24937 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260319 16:36:15.859654 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.861981 24949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.862080 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:15.861997 24948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.862174 24951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.862386 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.862427 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.862442 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175862441 us; error 0 us; skew 500 ppm
I20260319 16:36:15.863132 23293 webserver.cc:492] Webserver started at http://127.22.191.65:42365/ using document root <none> and password file <none>
I20260319 16:36:15.863237 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.863281 23293 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260319 16:36:15.863905 23293 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260319 16:36:15.864575 24956 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.864790 23293 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260319 16:36:15.864851 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
uuid: "da8797ffecf84e808ca6fe4e2c66e534"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.864908 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.898043 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.898723 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.899046 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:15.900290 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260319 16:36:15.900398 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260319 16:36:15.900920 23293 ts_tablet_manager.cc:616] Registered 1 tablets
I20260319 16:36:15.900957 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.901002 24963 tablet_bootstrap.cc:492] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Bootstrap starting.
I20260319 16:36:15.902493 24963 tablet_bootstrap.cc:492] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260319 16:36:15.902750 24963 tablet_bootstrap.cc:492] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Bootstrap complete.
I20260319 16:36:15.902858 24963 ts_tablet_manager.cc:1403] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260319 16:36:15.903007 24963 raft_consensus.cc:359] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.903077 24963 raft_consensus.cc:740] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: da8797ffecf84e808ca6fe4e2c66e534, State: Initialized, Role: FOLLOWER
I20260319 16:36:15.903123 24963 consensus_queue.cc:260] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.903162 24963 raft_consensus.cc:399] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260319 16:36:15.903182 24963 raft_consensus.cc:493] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260319 16:36:15.903206 24963 raft_consensus.cc:3060] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 1 FOLLOWER]: Advancing to term 2
I20260319 16:36:15.904021 24963 raft_consensus.cc:515] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.904206 24963 leader_election.cc:304] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da8797ffecf84e808ca6fe4e2c66e534; no voters:
I20260319 16:36:15.904357 24963 leader_election.cc:290] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260319 16:36:15.904413 25009 raft_consensus.cc:2804] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 2 FOLLOWER]: Leader election won for term 2
I20260319 16:36:15.904544 25009 raft_consensus.cc:697] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 2 LEADER]: Becoming Leader. State: Replica: da8797ffecf84e808ca6fe4e2c66e534, State: Running, Role: LEADER
I20260319 16:36:15.904594 24963 ts_tablet_manager.cc:1434] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260319 16:36:15.904600 25009 consensus_queue.cc:237] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } }
I20260319 16:36:15.905632 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.65:46043
I20260319 16:36:15.905756 25026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.65:46043 every 8 connection(s)
I20260319 16:36:15.906438 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.908424 25031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.908576 25032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.908425 25034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.909018 23293 server_base.cc:1060] running on GCE node
I20260319 16:36:15.909258 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.909298 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.909317 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175909317 us; error 0 us; skew 500 ppm
I20260319 16:36:15.910331 23293 webserver.cc:492] Webserver started at http://127.22.191.66:42967/ using document root <none> and password file <none>
I20260319 16:36:15.910439 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.910490 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:15.910548 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:15.910835 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-1-root/instance:
uuid: "1c5364ef25d94441ae6dcc1f0eefbd5a"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.911329 25027 heartbeater.cc:344] Connected to a master server at 127.22.191.126:41245
I20260319 16:36:15.911389 25027 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:15.911500 25027 heartbeater.cc:507] Master 127.22.191.126:41245 requested a full tablet report, sending...
I20260319 16:36:15.911979 24892 ts_manager.cc:194] Registered new tserver with Master: da8797ffecf84e808ca6fe4e2c66e534 (127.22.191.65:46043)
I20260319 16:36:15.912046 24892 catalog_manager.cc:5671] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "da8797ffecf84e808ca6fe4e2c66e534" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da8797ffecf84e808ca6fe4e2c66e534" member_type: VOTER last_known_addr { host: "127.22.191.65" port: 40505 } health_report { overall_health: HEALTHY } } }
I20260319 16:36:15.913122 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260319 16:36:15.913729 24892 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48538
I20260319 16:36:15.913903 25040 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.914445 25027 heartbeater.cc:499] Master 127.22.191.126:41245 was elected leader, sending a full tablet report...
I20260319 16:36:15.914891 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260319 16:36:15.914953 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-1-root
uuid: "1c5364ef25d94441ae6dcc1f0eefbd5a"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.915002 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.928117 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.928587 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.928807 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:15.929364 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:15.929411 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.929450 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:15.929466 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.933724 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.66:42751
I20260319 16:36:15.933768 25103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.66:42751 every 8 connection(s)
I20260319 16:36:15.934334 23293 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260319 16:36:15.936157 25108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260319 16:36:15.936165 25107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.936757 23293 server_base.cc:1060] running on GCE node
W20260319 16:36:15.936249 25110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260319 16:36:15.937156 23293 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260319 16:36:15.937203 23293 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260319 16:36:15.937223 23293 hybrid_clock.cc:648] HybridClock initialized: now 1773938175937223 us; error 0 us; skew 500 ppm
I20260319 16:36:15.938355 23293 webserver.cc:492] Webserver started at http://127.22.191.67:33321/ using document root <none> and password file <none>
I20260319 16:36:15.938446 23293 fs_manager.cc:362] Metadata directory not provided
I20260319 16:36:15.938499 23293 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260319 16:36:15.938545 23293 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260319 16:36:15.938684 25104 heartbeater.cc:344] Connected to a master server at 127.22.191.126:41245
I20260319 16:36:15.938763 25104 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:15.938867 23293 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-2-root/instance:
uuid: "094eca49465746aea83082e9ea63d740"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.938887 25104 heartbeater.cc:507] Master 127.22.191.126:41245 requested a full tablet report, sending...
I20260319 16:36:15.939280 24892 ts_manager.cc:194] Registered new tserver with Master: 1c5364ef25d94441ae6dcc1f0eefbd5a (127.22.191.66:42751)
I20260319 16:36:15.939725 24892 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48546
I20260319 16:36:15.940438 23293 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260319 16:36:15.941309 25115 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.941521 23293 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260319 16:36:15.941577 23293 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-2-root
uuid: "094eca49465746aea83082e9ea63d740"
format_stamp: "Formatted at 2026-03-19 16:36:15 on dist-test-slave-qk5m"
I20260319 16:36:15.941630 23293 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task5P2U6e/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1773938138919687-23293-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260319 16:36:15.966722 23293 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260319 16:36:15.967255 23293 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260319 16:36:15.967475 23293 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260319 16:36:15.967694 23293 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260319 16:36:15.967731 23293 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.967765 23293 ts_tablet_manager.cc:616] Registered 0 tablets
I20260319 16:36:15.967883 23293 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260319 16:36:15.971766 23293 rpc_server.cc:307] RPC server started. Bound to: 127.22.191.67:37241
I20260319 16:36:15.971983 25178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.191.67:37241 every 8 connection(s)
I20260319 16:36:15.976686 25179 heartbeater.cc:344] Connected to a master server at 127.22.191.126:41245
I20260319 16:36:15.976790 25179 heartbeater.cc:461] Registering TS with master...
I20260319 16:36:15.976891 25179 heartbeater.cc:507] Master 127.22.191.126:41245 requested a full tablet report, sending...
I20260319 16:36:15.977414 24892 ts_manager.cc:194] Registered new tserver with Master: 094eca49465746aea83082e9ea63d740 (127.22.191.67:37241)
I20260319 16:36:15.977769 23293 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005731478s
I20260319 16:36:15.977846 24892 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48562
I20260319 16:36:15.997805 23293 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260319 16:36:15.997920 23293 tablet_server.cc:178] TabletServer@127.22.191.65:0 shutting down...
I20260319 16:36:16.001266 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:16.002075 23293 tablet_replica.cc:333] stopping tablet replica
I20260319 16:36:16.002182 23293 raft_consensus.cc:2243] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 2 LEADER]: Raft consensus shutting down.
I20260319 16:36:16.002247 23293 raft_consensus.cc:2272] T 4b4209f6779a48bea40f6a7023a5c3ec P da8797ffecf84e808ca6fe4e2c66e534 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:16.015741 23293 tablet_server.cc:195] TabletServer@127.22.191.65:0 shutdown complete.
I20260319 16:36:16.017469 23293 tablet_server.cc:178] TabletServer@127.22.191.66:0 shutting down...
I20260319 16:36:16.020717 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:16.033027 23293 tablet_server.cc:195] TabletServer@127.22.191.66:0 shutdown complete.
I20260319 16:36:16.034340 23293 tablet_server.cc:178] TabletServer@127.22.191.67:0 shutting down...
I20260319 16:36:16.037472 23293 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260319 16:36:16.049507 23293 tablet_server.cc:195] TabletServer@127.22.191.67:0 shutdown complete.
I20260319 16:36:16.050622 23293 master.cc:561] Master@127.22.191.126:41245 shutting down...
I20260319 16:36:16.054154 23293 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 2 LEADER]: Raft consensus shutting down.
I20260319 16:36:16.054260 23293 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0ee5da8ba6e04456aea3a1c2b131f6d1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260319 16:36:16.054410 23293 tablet_replica.cc:333] stopping tablet replica
I20260319 16:36:16.067289 23293 master.cc:583] Master@127.22.191.126:41245 shutdown complete.
[ OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (416 ms)
[----------] 4 tests from TimestampAdvancementITest (37147 ms total)
[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (37147 ms total)
[ PASSED ] 3 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
1 FAILED TEST
I20260319 16:36:16.072118 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5349: suppressed but not reported on 9 messages since previous log ~1 seconds ago
I20260319 16:36:16.072172 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260319 16:36:16.072197 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260319 16:36:16.072229 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 11 messages since previous log ~2 seconds ago
I20260319 16:36:16.072288 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~4 seconds ago
I20260319 16:36:16.072356 23293 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 567 messages since previous log ~37 seconds ago