[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260621 08:05:00.341472 10591 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.87.254:42931
I20260621 08:05:00.341789 10591 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260621 08:05:00.341940 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:00.345783 10597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:00.345831 10596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:00.345824 10599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.346035 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:00.346226 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:00.346267 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:00.346285 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029100346286 us; error 0 us; skew 500 ppm
I20260621 08:05:00.347287 10591 webserver.cc:533] Webserver started at http://127.10.87.254:33587/ using document root <none> and password file <none>
I20260621 08:05:00.347445 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:00.347493 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:00.347569 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:00.348531 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/master-0-root/instance:
uuid: "aac670c993ac4826ad58623a1f2e1705"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.349655 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260621 08:05:00.350215 10604 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.350343 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260621 08:05:00.350419 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/master-0-root
uuid: "aac670c993ac4826ad58623a1f2e1705"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.350476 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:00.372722 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:00.373006 10591 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260621 08:05:00.373114 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:00.373456 10610 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260621 08:05:00.377524 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.254:42931
I20260621 08:05:00.377580 10656 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.254:42931 every 8 connection(s)
I20260621 08:05:00.378183 10657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:00.380578 10657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: Bootstrap starting.
I20260621 08:05:00.381403 10657 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:00.381628 10657 log.cc:826] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: Log is configured to *not* fsync() on all Append() calls
I20260621 08:05:00.382171 10657 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: No bootstrap required, opened a new log
I20260621 08:05:00.383383 10657 raft_consensus.cc:359] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER }
I20260621 08:05:00.383476 10657 raft_consensus.cc:385] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:00.383497 10657 raft_consensus.cc:740] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aac670c993ac4826ad58623a1f2e1705, State: Initialized, Role: FOLLOWER
I20260621 08:05:00.383602 10657 consensus_queue.cc:260] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER }
I20260621 08:05:00.383656 10657 raft_consensus.cc:399] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:00.383677 10657 raft_consensus.cc:493] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:00.383708 10657 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:00.384193 10657 raft_consensus.cc:515] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER }
I20260621 08:05:00.384279 10657 leader_election.cc:304] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aac670c993ac4826ad58623a1f2e1705; no voters:
I20260621 08:05:00.384409 10657 leader_election.cc:290] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260621 08:05:00.384498 10660 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:00.384615 10660 raft_consensus.cc:697] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 1 LEADER]: Becoming Leader. State: Replica: aac670c993ac4826ad58623a1f2e1705, State: Running, Role: LEADER
I20260621 08:05:00.384636 10657 sys_catalog.cc:565] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 08:05:00.384693 10660 consensus_queue.cc:237] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER }
I20260621 08:05:00.385087 10661 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aac670c993ac4826ad58623a1f2e1705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER } }
I20260621 08:05:00.385237 10661 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:00.385105 10662 sys_catalog.cc:455] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aac670c993ac4826ad58623a1f2e1705. Latest consensus state: current_term: 1 leader_uuid: "aac670c993ac4826ad58623a1f2e1705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aac670c993ac4826ad58623a1f2e1705" member_type: VOTER } }
I20260621 08:05:00.385484 10662 sys_catalog.cc:458] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:00.385532 10668 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260621 08:05:00.385957 10668 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260621 08:05:00.386154 10591 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260621 08:05:00.387316 10668 catalog_manager.cc:1382] Generated new cluster ID: 9b9bd7186548433984d936bc17ca4e43
I20260621 08:05:00.387368 10668 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260621 08:05:00.392545 10668 catalog_manager.cc:1405] Generated new certificate authority record
I20260621 08:05:00.393028 10668 catalog_manager.cc:1539] Loading token signing keys...
I20260621 08:05:00.400043 10668 catalog_manager.cc:6069] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: Generated new TSK 0
I20260621 08:05:00.400218 10668 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260621 08:05:00.401880 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:00.402038 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:00.403467 10679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:00.403658 10680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.403728 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:00.403939 10682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.404098 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:00.404145 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:00.404163 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029100404163 us; error 0 us; skew 500 ppm
I20260621 08:05:00.404762 10591 webserver.cc:533] Webserver started at http://127.10.87.193:44039/ using document root <none> and password file <none>
I20260621 08:05:00.404848 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:00.404896 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:00.404942 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:00.405226 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-0-root/instance:
uuid: "faa2a97af39849ad8965a6ac2e7db63b"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.406286 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:00.406950 10687 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.407100 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.407152 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "faa2a97af39849ad8965a6ac2e7db63b"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.407200 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:00.421275 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:00.421593 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:00.421814 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:00.422133 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:00.422174 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.422211 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:00.422235 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.426602 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:39499
I20260621 08:05:00.426631 10750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:39499 every 8 connection(s)
I20260621 08:05:00.427083 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:00.427248 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:00.428735 10755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:00.428836 10756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.429241 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:00.429396 10758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.429558 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:00.429590 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:00.429606 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029100429607 us; error 0 us; skew 500 ppm
I20260621 08:05:00.430163 10591 webserver.cc:533] Webserver started at http://127.10.87.194:37227/ using document root <none> and password file <none>
I20260621 08:05:00.430246 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:00.430296 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:00.430351 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:00.430627 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-1-root/instance:
uuid: "13f448ddc3ad452194e7f31887156e0f"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.431630 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:00.432072 10763 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.432207 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.432246 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-1-root
uuid: "13f448ddc3ad452194e7f31887156e0f"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.432291 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:00.434545 10751 heartbeater.cc:344] Connected to a master server at 127.10.87.254:42931
I20260621 08:05:00.434628 10751 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:00.434784 10751 heartbeater.cc:507] Master 127.10.87.254:42931 requested a full tablet report, sending...
I20260621 08:05:00.435278 10621 ts_manager.cc:194] Registered new tserver with Master: faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:00.436236 10621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46120
I20260621 08:05:00.451941 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:00.452211 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:00.452397 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:00.452590 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:00.452620 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.452649 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:00.452667 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.455974 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.194:33955
I20260621 08:05:00.456055 10827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.194:33955 every 8 connection(s)
I20260621 08:05:00.456338 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:00.456446 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:00.457623 10831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:00.457897 10834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.458058 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:00.458117 10832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:00.458251 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:00.458288 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:00.458304 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029100458305 us; error 0 us; skew 500 ppm
I20260621 08:05:00.459106 10591 webserver.cc:533] Webserver started at http://127.10.87.195:38637/ using document root <none> and password file <none>
I20260621 08:05:00.459203 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:00.459275 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:00.459319 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:00.459628 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-2-root/instance:
uuid: "772d4e03613f477a8c7dbc9bf212f851"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.459681 10828 heartbeater.cc:344] Connected to a master server at 127.10.87.254:42931
I20260621 08:05:00.459738 10828 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:00.459851 10828 heartbeater.cc:507] Master 127.10.87.254:42931 requested a full tablet report, sending...
I20260621 08:05:00.460074 10621 ts_manager.cc:194] Registered new tserver with Master: 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955)
I20260621 08:05:00.460548 10621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46124
I20260621 08:05:00.460616 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:00.461093 10839 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.461212 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.461259 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-2-root
uuid: "772d4e03613f477a8c7dbc9bf212f851"
format_stamp: "Formatted at 2026-06-21 08:05:00 on dist-test-slave-brsg"
I20260621 08:05:00.461301 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:00.473405 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:00.473666 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:00.473815 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:00.474035 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:00.474068 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.474089 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:00.474113 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.477973 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.195:35497
I20260621 08:05:00.478039 10903 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.195:35497 every 8 connection(s)
I20260621 08:05:00.481591 10904 heartbeater.cc:344] Connected to a master server at 127.10.87.254:42931
I20260621 08:05:00.481662 10904 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:00.481755 10904 heartbeater.cc:507] Master 127.10.87.254:42931 requested a full tablet report, sending...
I20260621 08:05:00.481985 10621 ts_manager.cc:194] Registered new tserver with Master: 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:00.482355 10621 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46132
I20260621 08:05:00.482671 10591 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004520301s
I20260621 08:05:00.496685 10621 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46148:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260621 08:05:00.496917 10621 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 08:05:00.503130 10792 tablet_service.cc:1511] Processing CreateTablet for tablet 23a038f11d1b4a78a8a4220145ac5763 (DEFAULT_TABLE table=test-workload [id=6b2238007ffa4c768780749caa6ec7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:00.503365 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a038f11d1b4a78a8a4220145ac5763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:00.503330 10868 tablet_service.cc:1511] Processing CreateTablet for tablet 23a038f11d1b4a78a8a4220145ac5763 (DEFAULT_TABLE table=test-workload [id=6b2238007ffa4c768780749caa6ec7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:00.503424 10715 tablet_service.cc:1511] Processing CreateTablet for tablet 23a038f11d1b4a78a8a4220145ac5763 (DEFAULT_TABLE table=test-workload [id=6b2238007ffa4c768780749caa6ec7ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:00.503479 10868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a038f11d1b4a78a8a4220145ac5763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:00.503497 10715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23a038f11d1b4a78a8a4220145ac5763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:00.505369 10925 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Bootstrap starting.
I20260621 08:05:00.505743 10925 tablet_bootstrap.cc:654] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:00.506057 10926 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Bootstrap starting.
I20260621 08:05:00.506418 10926 tablet_bootstrap.cc:654] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:00.506726 10927 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Bootstrap starting.
I20260621 08:05:00.507084 10927 tablet_bootstrap.cc:654] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:00.507447 10926 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: No bootstrap required, opened a new log
I20260621 08:05:00.507503 10926 ts_tablet_manager.cc:1403] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:00.507683 10926 raft_consensus.cc:359] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.507758 10926 raft_consensus.cc:385] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:00.507773 10926 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Initialized, Role: FOLLOWER
I20260621 08:05:00.507805 10926 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.508100 10927 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: No bootstrap required, opened a new log
I20260621 08:05:00.508230 10926 ts_tablet_manager.cc:1434] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:00.508251 10927 ts_tablet_manager.cc:1403] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260621 08:05:00.508039 10925 tablet_bootstrap.cc:492] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: No bootstrap required, opened a new log
I20260621 08:05:00.508289 10751 heartbeater.cc:499] Master 127.10.87.254:42931 was elected leader, sending a full tablet report...
I20260621 08:05:00.508407 10925 ts_tablet_manager.cc:1403] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260621 08:05:00.508533 10925 raft_consensus.cc:359] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.508594 10925 raft_consensus.cc:385] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:00.508620 10925 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Initialized, Role: FOLLOWER
I20260621 08:05:00.508674 10925 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.508690 10927 raft_consensus.cc:359] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.508826 10925 ts_tablet_manager.cc:1434] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:00.508904 10828 heartbeater.cc:499] Master 127.10.87.254:42931 was elected leader, sending a full tablet report...
I20260621 08:05:00.508846 10927 raft_consensus.cc:385] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:00.509102 10927 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Initialized, Role: FOLLOWER
I20260621 08:05:00.509233 10927 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.509460 10927 ts_tablet_manager.cc:1434] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:00.509478 10904 heartbeater.cc:499] Master 127.10.87.254:42931 was elected leader, sending a full tablet report...
I20260621 08:05:00.565977 10932 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 08:05:00.566071 10932 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.566321 10932 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:00.568800 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b" is_pre_election: true
I20260621 08:05:00.568859 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851" is_pre_election: true
I20260621 08:05:00.568928 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 0.
I20260621 08:05:00.568928 10878 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 0.
I20260621 08:05:00.569139 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:00.569257 10932 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 08:05:00.569311 10932 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:00.569336 10932 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:00.569931 10932 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.570055 10932 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 1 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:00.570173 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:00.570230 10878 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:00.570222 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:00.570314 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:00.570835 10878 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 1.
I20260621 08:05:00.570883 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 1.
I20260621 08:05:00.570997 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:00.571082 10932 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:00.571210 10932 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:00.571285 10932 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.571923 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 0 to 1, leader changed from <none> to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 1 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:00.596175 10878 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 1 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 08:05:00.596175 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 1 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 08:05:00.596436 10935 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:00.596560 10932 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:00.617193 10591 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260621 08:05:00.845114 10931 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:00.845206 10931 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:00.845919 10931 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.846105 10931 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 2 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:00.848479 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:00.848521 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:00.848712 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:00.848798 10931 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260621 08:05:00.867794 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 1. Current term is 2. Ops: []
I20260621 08:05:00.868062 10935 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 1.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
W20260621 08:05:00.868189 10947 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260621 08:05:00.868221 10947 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260621 08:05:00.877374 10947 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 LEADER]: Stepping down as leader of term 1
I20260621 08:05:00.877458 10947 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:00.877542 10947 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 1.42, Last appended by leader: 42, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.877661 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:00.939184 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:00.939322 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:00.939998 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.940199 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 2 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:00.942631 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:00.942631 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 2 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:00.942819 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 2: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:00.943468 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 2.
I20260621 08:05:00.943629 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:00.943724 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 FOLLOWER]: Leader election won for term 2
I20260621 08:05:00.943850 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:00.943930 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 1.42, Last appended by leader: 42, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.944362 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 1 to 2, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 2 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:00.955147 10931 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:00.955336 10931 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:00.956038 10931 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:00.956244 10931 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 3 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:00.956488 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 3 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:00.956560 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:00.956524 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 3 candidate_status { last_received { term: 1 index: 42 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:00.957175 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 3.
I20260621 08:05:00.957418 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:00.957541 10931 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 FOLLOWER]: Leader election won for term 3
I20260621 08:05:00.957667 10931 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:00.957739 10931 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 1.42, Last appended by leader: 42, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.022202 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 2 to 3, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 3 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:01.034862 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 3 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 2. Current term is 3. Ops: []
I20260621 08:05:01.035204 10933 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260621 08:05:01.047504 10933 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 LEADER]: Stepping down as leader of term 2
I20260621 08:05:01.047605 10933 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:01.047698 10933 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 2.43, Last appended by leader: 43, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.047797 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:01.049804 10878 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 3 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 2 index: 43. Preceding OpId from leader: term: 3 index: 43. (term mismatch)
I20260621 08:05:01.049906 10878 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 42
I20260621 08:05:01.049952 10878 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 2.43
I20260621 08:05:01.049993 10878 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:01.050295 10931 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260621 08:05:01.058578 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 3 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 1 index: 42. Preceding OpId from leader: term: 3 index: 43. (index mismatch)
I20260621 08:05:01.058789 10975 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260621 08:05:01.159354 10947 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 3 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:01.159459 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:01.160181 10947 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.160296 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 3. Current term is 4. Ops: []
I20260621 08:05:01.160367 10947 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 4 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:01.160480 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:01.160509 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 4 candidate_status { last_received { term: 3 index: 43 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:01.160528 10975 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 3.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260621 08:05:01.160583 10878 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:01.161159 10878 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 4.
I20260621 08:05:01.161341 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:01.161439 10947 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 FOLLOWER]: Leader election won for term 4
I20260621 08:05:01.161485 10947 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:01.161531 10947 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 3.43, Last appended by leader: 43, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.161939 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 3 to 4, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 4 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:01.174230 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 4 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 3. Current term is 4. Ops: []
I20260621 08:05:01.174531 10931 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 3.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260621 08:05:01.196959 10975 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 LEADER]: Stepping down as leader of term 3
I20260621 08:05:01.197039 10975 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:01.197105 10975 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 3.43, Last appended by leader: 43, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.197207 10975 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:01.238442 10878 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 4 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 43. Preceding OpId from leader: term: 4 index: 44. (index mismatch)
I20260621 08:05:01.238699 10947 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260621 08:05:01.277570 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 4 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 3 index: 43. Preceding OpId from leader: term: 4 index: 44. (index mismatch)
I20260621 08:05:01.277912 10947 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260621 08:05:01.428278 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:01.428382 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:01.436159 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.436329 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 4. Current term is 5. Ops: []
I20260621 08:05:01.436378 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 5 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:01.436641 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:01.436641 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:01.436805 10976 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 4.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260621 08:05:01.436887 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:01.436969 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260621 08:05:01.462996 10975 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:01.463094 10975 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:01.463806 10975 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.463948 10975 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 5 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:01.464200 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:01.464267 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 5 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:01.464342 10878 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 5: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:01.464497 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:01.464586 10975 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260621 08:05:01.471197 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 5 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 4. Current term is 5. Ops: []
I20260621 08:05:01.471449 10976 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 4.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260621 08:05:01.507697 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 4. Current term is 5. Ops: []
I20260621 08:05:01.507967 10947 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 4.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260621 08:05:01.518033 10935 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 LEADER]: Stepping down as leader of term 4
I20260621 08:05:01.518116 10935 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:01.518194 10935 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.518308 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:01.555090 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:01.555193 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:01.555912 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.556078 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 6 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:01.556340 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 6 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:01.556340 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 6 candidate_status { last_received { term: 4 index: 44 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:01.556485 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:01.556489 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:01.557152 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 6.
I20260621 08:05:01.557152 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 6.
I20260621 08:05:01.557364 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:01.557487 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 FOLLOWER]: Leader election won for term 6
I20260621 08:05:01.557587 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:01.557641 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 4.44, Last appended by leader: 44, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.558104 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 4 to 6, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 6 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:01.646615 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 6 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 4 index: 44. Preceding OpId from leader: term: 6 index: 45. (index mismatch)
I20260621 08:05:01.647001 10933 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260621 08:05:01.676451 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 6 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 4 index: 44. Preceding OpId from leader: term: 6 index: 45. (index mismatch)
I20260621 08:05:01.676767 10978 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260621 08:05:01.778177 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:01.778280 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:01.778940 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.779106 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 7 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:01.779397 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:01.779398 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 7 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:01.779628 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:01.779724 10935 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260621 08:05:01.791247 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 7 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 6. Current term is 7. Ops: []
I20260621 08:05:01.791539 10977 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 6.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260621 08:05:01.873179 10978 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 LEADER]: Stepping down as leader of term 6
I20260621 08:05:01.873268 10978 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:01.873332 10978 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 6.45, Last appended by leader: 45, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.873440 10978 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:01.903177 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:01.903302 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:01.904037 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.904196 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 8 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:01.904431 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:01.904449 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 8 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:01.904522 10878 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:01.905048 10878 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 8.
I20260621 08:05:01.905218 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:01.905308 10935 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 FOLLOWER]: Leader election won for term 8
I20260621 08:05:01.905364 10935 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:01.905411 10935 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 6.45, Last appended by leader: 45, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.905814 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 6 to 8, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 8 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:01.940934 10975 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:01.941028 10975 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:01.941658 10975 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:01.941804 10975 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 7 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:01.942088 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 7 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:01.942094 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 7 candidate_status { last_received { term: 6 index: 45 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:01.942183 10878 raft_consensus.cc:2368] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 7. Current term is 8.
I20260621 08:05:01.942356 10690 leader_election.cc:400] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 7 election: Vote denied by peer 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 7. Current term is 8.
I20260621 08:05:01.942389 10690 leader_election.cc:403] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260621 08:05:01.942453 10975 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:01.942987 10975 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 7. Current term is 8.
I20260621 08:05:02.007958 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 8 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 45. Preceding OpId from leader: term: 8 index: 46. (index mismatch)
I20260621 08:05:02.008244 10935 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260621 08:05:02.025497 10878 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 6 index: 45. Preceding OpId from leader: term: 8 index: 46. (index mismatch)
I20260621 08:05:02.025799 10935 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260621 08:05:02.126888 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:02.127014 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:02.128711 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.128871 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 8. Current term is 9. Ops: []
I20260621 08:05:02.128973 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 9 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:02.129119 10935 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 8.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.129127 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 9 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:02.129150 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 9 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.129364 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:02.129470 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260621 08:05:02.195578 10975 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:02.195695 10975 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:02.243033 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 8. Current term is 9. Ops: []
I20260621 08:05:02.243335 10935 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 8.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.245905 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:02.245972 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:02.247465 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.247465 10975 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.247623 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 9 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 8. Current term is 9. Ops: []
I20260621 08:05:02.247660 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 10 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:02.247908 10935 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 8.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.247952 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 10 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:02.248023 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:02.248054 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 9 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.248082 10975 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 9 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:02.248149 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 9 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:02.248204 10878 raft_consensus.cc:2368] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 9. Current term is 10.
I20260621 08:05:02.247958 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 10 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.248312 10690 leader_election.cc:400] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 9 election: Vote denied by peer 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 9. Current term is 10.
I20260621 08:05:02.248343 10690 leader_election.cc:403] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260621 08:05:02.251338 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 10.
I20260621 08:05:02.251452 10979 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for earlier term 9. Current term is 10.
I20260621 08:05:02.251528 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:02.251619 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Leader election won for term 10
I20260621 08:05:02.251677 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:02.251796 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 8.46, Last appended by leader: 46, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.252205 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 8 to 10, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 10 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:02.269762 10947 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 LEADER]: Stepping down as leader of term 8
I20260621 08:05:02.269853 10947 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:02.269932 10947 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 8.46, Last appended by leader: 46, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.270047 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:02.343487 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:02.348537 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 10 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 8 index: 46. Preceding OpId from leader: term: 10 index: 47. (index mismatch)
I20260621 08:05:02.348879 10933 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.354849 10979 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:02.354943 10979 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:02.440035 10979 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.440243 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 10. Current term is 11. Ops: []
I20260621 08:05:02.440454 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.440560 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 11 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:02.440464 10979 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 11 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:02.440763 10933 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.440728 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 11 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.441030 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:02.441121 10979 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260621 08:05:02.441690 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.443842 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.448004 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.448006 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 10. Current term is 11. Ops: [10.47-10.47]
I20260621 08:05:02.448276 10933 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 8.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.456208 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.472473 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.496995 10978 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 LEADER]: Stepping down as leader of term 10
I20260621 08:05:02.497102 10978 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:02.497161 10978 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 10.47, Last appended by leader: 47, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.497265 10978 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:02.504778 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.543815 10947 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:02.543910 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:02.569042 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.611624 10979 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:02.611734 10979 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:02.638867 10947 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.638867 10979 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.639122 10947 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 11 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:02.639333 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:02.639380 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 11 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:02.639488 10725 raft_consensus.cc:2368] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f for earlier term 11. Current term is 12.
I20260621 08:05:02.639642 10767 leader_election.cc:400] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 11 election: Vote denied by peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f for earlier term 11. Current term is 12.
I20260621 08:05:02.639672 10767 leader_election.cc:403] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260621 08:05:02.639698 10979 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 12 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:02.639729 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:02.640100 10878 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 11.
I20260621 08:05:02.640349 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 12 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:02.640372 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 12 candidate_status { last_received { term: 8 index: 46 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.640416 10878 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:02.647156 10947 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f for earlier term 11. Current term is 12.
I20260621 08:05:02.647399 10802 raft_consensus.cc:2410] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for term 12 because replica has last-logged OpId of term: 10 index: 47, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 46.
I20260621 08:05:02.663455 10878 raft_consensus.cc:2410] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for term 12 because replica has last-logged OpId of term: 10 index: 47, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 46.
I20260621 08:05:02.663707 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:02.663798 10979 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260621 08:05:02.697312 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:02.757619 10947 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:02.757728 10947 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 12 FOLLOWER]: Advancing to term 13
I20260621 08:05:02.789147 10978 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:02.789253 10978 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 12 FOLLOWER]: Advancing to term 13
I20260621 08:05:02.835788 10947 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.835788 10978 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.836050 10947 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 13 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:02.836202 10978 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 13 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:02.836284 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:02.836355 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 13 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:02.836402 10878 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 13: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:02.836417 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 12 FOLLOWER]: Advancing to term 13
I20260621 08:05:02.836432 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 13 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:02.836483 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 13 candidate_status { last_received { term: 10 index: 47 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:02.836539 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 13: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:02.837083 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 13.
I20260621 08:05:02.837286 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:02.837297 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:02.837411 10978 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260621 08:05:02.837448 10947 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 FOLLOWER]: Leader election won for term 13
I20260621 08:05:02.837495 10947 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:02.837540 10947 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 10.47, Last appended by leader: 47, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:02.837978 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 10 to 13, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 13 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:02.929733 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 13 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 8 index: 46. Preceding OpId from leader: term: 13 index: 48. (index mismatch)
I20260621 08:05:02.930066 10947 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 46, Time since last communication: 0.000s
I20260621 08:05:02.931242 10878 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 10 index: 47. Preceding OpId from leader: term: 13 index: 48. (index mismatch)
I20260621 08:05:02.931454 10935 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260621 08:05:02.953539 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:03.032397 10978 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:03.032536 10978 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:03.034940 10978 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.035127 10978 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 14 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:03.035384 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 14 candidate_status { last_received { term: 13 index: 48 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:03.035382 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 14 candidate_status { last_received { term: 13 index: 48 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:03.035511 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:03.036068 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 14.
I20260621 08:05:03.036237 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:03.036343 10978 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 FOLLOWER]: Leader election won for term 14
I20260621 08:05:03.036406 10978 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:03.036464 10978 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 13.48, Last appended by leader: 48, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.036944 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 13 to 14, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 14 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:03.047734 10878 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 13. Current term is 14. Ops: []
I20260621 08:05:03.048028 10947 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 13.48, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260621 08:05:03.048125 10947 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 14.49 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 48
I20260621 08:05:03.048159 10935 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 LEADER]: Stepping down as leader of term 13
I20260621 08:05:03.048223 10935 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:03.048280 10935 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 13.48, Last appended by leader: 48, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.048377 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:03.125449 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 14 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 13 index: 48. Preceding OpId from leader: term: 14 index: 49. (index mismatch)
I20260621 08:05:03.125766 10978 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260621 08:05:03.132654 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 14 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 13 index: 48. Preceding OpId from leader: term: 14 index: 49. (index mismatch)
I20260621 08:05:03.133004 10933 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260621 08:05:03.391007 10979 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:03.391103 10979 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 14 FOLLOWER]: Advancing to term 15
I20260621 08:05:03.416145 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:03.416250 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 14 FOLLOWER]: Advancing to term 15
I20260621 08:05:03.430261 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.430261 10979 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.430493 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 15 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:03.430512 10979 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 15 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:03.430568 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 14. Current term is 15. Ops: []
I20260621 08:05:03.430806 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 15 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:03.430825 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:03.430853 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 15 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:03.430891 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 15: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:03.431013 10978 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 14.49, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260621 08:05:03.431115 10933 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 LEADER]: Stepping down as leader of term 14
I20260621 08:05:03.431151 10933 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:03.431209 10933 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 14.49, Last appended by leader: 49, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.431303 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 14 FOLLOWER]: Advancing to term 15
I20260621 08:05:03.431330 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 15 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:03.431375 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 15: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:03.431486 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:03.431571 10979 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260621 08:05:03.431641 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:03.431694 10935 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260621 08:05:03.465776 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:03.539085 10979 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:03.539186 10979 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 15 FOLLOWER]: Advancing to term 16
I20260621 08:05:03.546241 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:03.546337 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 15 FOLLOWER]: Advancing to term 16
I20260621 08:05:03.629428 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.629465 10979 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.629731 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 16 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:03.629732 10979 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 16 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:03.629942 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 16 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:03.630015 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 15 FOLLOWER]: Advancing to term 16
I20260621 08:05:03.630025 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:03.630054 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 16 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:03.630090 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 16: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:03.630098 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 16: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:03.630393 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 16 candidate_status { last_received { term: 14 index: 49 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:03.630563 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:03.630643 10935 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260621 08:05:03.630834 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 16.
I20260621 08:05:03.631036 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:03.631146 10979 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 FOLLOWER]: Leader election won for term 16
I20260621 08:05:03.631290 10979 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:03.631347 10979 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 14.49, Last appended by leader: 49, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.631916 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 14 to 16, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 16 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:03.718519 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 16 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 14 index: 49. Preceding OpId from leader: term: 16 index: 50. (index mismatch)
I20260621 08:05:03.718892 10981 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260621 08:05:03.719105 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 14 index: 49. Preceding OpId from leader: term: 16 index: 50. (index mismatch)
I20260621 08:05:03.719435 10981 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260621 08:05:03.821336 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:03.821455 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 16 FOLLOWER]: Advancing to term 17
I20260621 08:05:03.828497 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.828714 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 17 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:03.828927 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:03.828933 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 17 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:03.829193 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:03.829291 10935 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260621 08:05:03.838652 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 16. Current term is 17. Ops: []
I20260621 08:05:03.838940 10979 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 16.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260621 08:05:03.839077 10985 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 LEADER]: Stepping down as leader of term 16
I20260621 08:05:03.839139 10985 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:03.839246 10985 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 16.50, Last appended by leader: 50, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.839350 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 16 FOLLOWER]: Advancing to term 17
I20260621 08:05:03.898658 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 16 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:03.898765 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 16 FOLLOWER]: Advancing to term 17
I20260621 08:05:03.929162 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.929381 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 17 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:03.929601 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 17 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:03.929576 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 17 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:03.929668 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 17: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:03.930271 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 17.
I20260621 08:05:03.930464 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:03.930593 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 FOLLOWER]: Leader election won for term 17
I20260621 08:05:03.930658 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:03.930711 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 16.50, Last appended by leader: 50, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:03.931156 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 16 to 17, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 17 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:03.959787 10935 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:03.959905 10935 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 17 FOLLOWER]: Advancing to term 18
I20260621 08:05:04.024132 10935 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.024386 10935 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 18 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.024636 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.024736 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 17 FOLLOWER]: Advancing to term 18
I20260621 08:05:04.024636 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 18 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.025516 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 18.
I20260621 08:05:04.025730 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:04.025856 10935 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 FOLLOWER]: Leader election won for term 18
I20260621 08:05:04.026047 10935 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:04.026106 10935 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 16.50, Last appended by leader: 50, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.026607 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 17 to 18, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 18 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:04.034583 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 18 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 17. Current term is 18. Ops: []
I20260621 08:05:04.034847 10933 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260621 08:05:04.034967 10933 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 LEADER]: Stepping down as leader of term 17
I20260621 08:05:04.035002 10933 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:04.035060 10933 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 17.51, Last appended by leader: 51, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.035130 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 17 FOLLOWER]: Advancing to term 18
I20260621 08:05:04.125087 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 18 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 17 index: 51. Preceding OpId from leader: term: 18 index: 51. (term mismatch)
I20260621 08:05:04.125186 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 50
I20260621 08:05:04.125204 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 17.51
I20260621 08:05:04.125224 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:04.125618 10935 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260621 08:05:04.125985 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.126083 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 18 FOLLOWER]: Advancing to term 19
I20260621 08:05:04.127470 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.127576 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 19 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 18. Current term is 19. Ops: []
I20260621 08:05:04.127730 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 19 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.127758 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 19 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.127929 10987 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260621 08:05:04.127956 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:04.128057 10987 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 LEADER]: Stepping down as leader of term 18
I20260621 08:05:04.128085 10987 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:04.128094 10979 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260621 08:05:04.128134 10987 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 18.51, Last appended by leader: 51, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.127954 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 19 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.128199 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 18 FOLLOWER]: Advancing to term 19
I20260621 08:05:04.241417 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.241541 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 19 FOLLOWER]: Advancing to term 20
I20260621 08:05:04.260526 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:04.260627 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 18 FOLLOWER]: Advancing to term 19
I20260621 08:05:04.326113 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.326113 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.326479 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 20 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.326578 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 19 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:04.326674 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 19 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.326681 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 20 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.326751 10725 raft_consensus.cc:2368] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 for earlier term 19. Current term is 20.
I20260621 08:05:04.326772 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 19 FOLLOWER]: Advancing to term 20
I20260621 08:05:04.326821 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 20 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.326866 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 19 FOLLOWER]: Advancing to term 20
I20260621 08:05:04.326925 10843 leader_election.cc:400] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 19 election: Vote denied by peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 for earlier term 19. Current term is 20.
I20260621 08:05:04.326961 10843 leader_election.cc:403] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260621 08:05:04.326776 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 19 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.327589 10877 raft_consensus.cc:2410] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for term 20 because replica has last-logged OpId of term: 18 index: 51, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 50.
I20260621 08:05:04.327652 10802 raft_consensus.cc:2410] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b for term 20 because replica has last-logged OpId of term: 18 index: 51, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 50.
I20260621 08:05:04.327740 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 for earlier term 19. Current term is 20.
I20260621 08:05:04.327783 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:04.327880 10985 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260621 08:05:04.456102 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.456199 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 20 FOLLOWER]: Advancing to term 21
I20260621 08:05:04.466017 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:04.481030 10987 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.481135 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 20 FOLLOWER]: Advancing to term 21
I20260621 08:05:04.489296 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.489406 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 20 FOLLOWER]: Advancing to term 21
I20260621 08:05:04.522809 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.522809 10987 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.522809 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.523141 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 21 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.523276 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 21 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:04.523389 10987 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 21 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.523439 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 21 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.523505 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 21 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.523479 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 21 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.523550 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 21: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:04.523550 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 21: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:04.523658 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 21 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.523702 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 21 candidate_status { last_received { term: 16 index: 50 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.523790 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 21 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.523844 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 21: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:04.523702 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 21: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:04.523948 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:04.523998 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:04.524041 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:04.524128 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260621 08:05:04.524035 10985 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260621 08:05:04.524102 10987 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260621 08:05:04.672752 10987 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:04.672853 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 21 FOLLOWER]: Advancing to term 22
I20260621 08:05:04.684316 10987 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.684597 10987 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 22 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.684808 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.684808 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 22 candidate_status { last_received { term: 18 index: 51 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.684952 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 21 FOLLOWER]: Advancing to term 22
I20260621 08:05:04.684937 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 21 FOLLOWER]: Advancing to term 22
I20260621 08:05:04.685757 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 22.
I20260621 08:05:04.685757 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 22.
I20260621 08:05:04.686034 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:04.686142 10987 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 FOLLOWER]: Leader election won for term 22
I20260621 08:05:04.686244 10987 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:04.686291 10987 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 18.51, Last appended by leader: 51, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.686722 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:04.776214 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 22 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 18 index: 51. Preceding OpId from leader: term: 22 index: 52. (index mismatch)
I20260621 08:05:04.776526 10987 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260621 08:05:04.777545 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 22 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 16 index: 50. Preceding OpId from leader: term: 22 index: 52. (index mismatch)
I20260621 08:05:04.777789 10988 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 50, Time since last communication: 0.000s
I20260621 08:05:04.878340 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:04.878466 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 22 FOLLOWER]: Advancing to term 23
I20260621 08:05:04.878677 10993 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:04.878732 10993 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 22 FOLLOWER]: Advancing to term 23
I20260621 08:05:04.880101 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.880084 10993 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.880312 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 23 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:04.880448 10993 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 23 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:04.880556 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.880581 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:04.880721 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:04.880775 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 23: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:04.880879 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:04.880889 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:04.880975 10993 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260621 08:05:04.880930 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 22. Current term is 23. Ops: []
I20260621 08:05:04.881065 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 23: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:04.881177 10988 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 22.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260621 08:05:04.881258 10988 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 LEADER]: Stepping down as leader of term 22
I20260621 08:05:04.881284 10988 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:04.881202 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:04.881341 10988 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 22.52, Last appended by leader: 52, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:04.881407 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 22 FOLLOWER]: Advancing to term 23
I20260621 08:05:04.881412 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260621 08:05:05.021499 10993 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:05.021611 10993 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 23 FOLLOWER]: Advancing to term 24
I20260621 08:05:05.021775 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:05.021842 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 23 FOLLOWER]: Advancing to term 24
I20260621 08:05:05.082986 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.082986 10993 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.083269 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 24 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:05.083472 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.083567 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 24: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:05.083484 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.083634 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 23 FOLLOWER]: Advancing to term 24
I20260621 08:05:05.083837 10993 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 24 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:05.083925 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:05.083985 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 24: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:05.083503 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.084204 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:05.084350 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260621 08:05:05.084468 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 24.
I20260621 08:05:05.084614 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:05.084758 10993 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 FOLLOWER]: Leader election won for term 24
I20260621 08:05:05.084815 10993 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:05.084854 10993 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 22.52, Last appended by leader: 52, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.085287 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 22 to 24, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 24 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:05.163792 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 22 index: 52. Preceding OpId from leader: term: 24 index: 53. (index mismatch)
I20260621 08:05:05.164103 10993 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260621 08:05:05.165062 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 24 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 22 index: 52. Preceding OpId from leader: term: 24 index: 53. (index mismatch)
I20260621 08:05:05.165299 10994 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260621 08:05:05.266356 10987 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 24 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:05.266450 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 24 FOLLOWER]: Advancing to term 25
I20260621 08:05:05.284866 10987 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.285092 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 24. Current term is 25. Ops: []
I20260621 08:05:05.285405 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:05.285120 10987 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 25 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:05.285496 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.285605 10985 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 24.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260621 08:05:05.285696 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:05.285703 10985 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 LEADER]: Stepping down as leader of term 24
I20260621 08:05:05.285761 10985 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:05.285774 10987 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260621 08:05:05.285842 10985 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.285918 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 24 FOLLOWER]: Advancing to term 25
I20260621 08:05:05.366052 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:05.366154 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 24 FOLLOWER]: Advancing to term 25
I20260621 08:05:05.382686 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.382891 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 25 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:05.383114 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.383127 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.383249 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 25: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:05.383839 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 25.
I20260621 08:05:05.384043 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:05.384162 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 FOLLOWER]: Leader election won for term 25
I20260621 08:05:05.384307 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:05.384359 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.384835 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 24 to 25, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 25 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:05.392583 10987 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:05.392668 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 25 FOLLOWER]: Advancing to term 26
I20260621 08:05:05.466261 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:05.481544 10987 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.481760 10987 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 26 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:05.481979 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 26 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:05.481995 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 26 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.482113 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 25 FOLLOWER]: Advancing to term 26
I20260621 08:05:05.482882 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 26.
I20260621 08:05:05.483083 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:05.483173 10987 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 FOLLOWER]: Leader election won for term 26
I20260621 08:05:05.483256 10987 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:05.483302 10987 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.483785 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 25 to 26, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 26 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:05.485004 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 25. Current term is 26. Ops: []
I20260621 08:05:05.485033 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 26 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 25. Current term is 26. Ops: []
I20260621 08:05:05.485209 10933 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260621 08:05:05.485389 10933 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 LEADER]: Stepping down as leader of term 25
I20260621 08:05:05.485430 10933 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:05.485407 10995 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260621 08:05:05.485491 10995 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 26.54 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 53
I20260621 08:05:05.485545 10933 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.54, Last appended by leader: 54, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.485615 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 25 FOLLOWER]: Advancing to term 26
I20260621 08:05:05.567939 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 26 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 24 index: 53. Preceding OpId from leader: term: 26 index: 54. (index mismatch)
I20260621 08:05:05.568216 10987 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260621 08:05:05.585156 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 26 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 25 index: 54. Preceding OpId from leader: term: 26 index: 54. (term mismatch)
I20260621 08:05:05.585245 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 53
I20260621 08:05:05.585265 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 25.54
I20260621 08:05:05.585291 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:05.585601 10987 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260621 08:05:05.802258 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:05.802367 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 26 FOLLOWER]: Advancing to term 27
I20260621 08:05:05.803045 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.803339 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 27 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:05.803433 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.803436 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.803753 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:05.803848 10933 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260621 08:05:05.826273 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 26. Current term is 27. Ops: []
I20260621 08:05:05.826566 10988 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 26.54, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260621 08:05:05.826692 10988 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 LEADER]: Stepping down as leader of term 26
I20260621 08:05:05.826727 10988 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:05.826797 10988 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.826870 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 26 FOLLOWER]: Advancing to term 27
I20260621 08:05:05.865430 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 26 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:05.865535 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 26 FOLLOWER]: Advancing to term 27
I20260621 08:05:05.866251 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.866449 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 27 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:05.866705 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.866786 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:05.866917 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 27: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:05.867451 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 27.
I20260621 08:05:05.867611 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:05.867705 10985 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 FOLLOWER]: Leader election won for term 27
I20260621 08:05:05.867805 10985 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:05.867864 10985 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.868283 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 26 to 27, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 27 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:05.913275 10933 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:05.913380 10933 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 27 FOLLOWER]: Advancing to term 28
I20260621 08:05:05.914052 10933 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.914211 10933 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 28 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:05.914426 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:05.914451 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:05.914534 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 27 FOLLOWER]: Advancing to term 28
I20260621 08:05:05.915096 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 28.
I20260621 08:05:05.915277 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:05.915364 10933 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 FOLLOWER]: Leader election won for term 28
I20260621 08:05:05.915418 10933 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:05.915493 10933 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.915901 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 27 to 28, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 28 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:05.957861 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 27. Current term is 28. Ops: []
I20260621 08:05:05.958122 10985 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260621 08:05:05.958206 10985 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 28.55 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 54
I20260621 08:05:05.958243 10998 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 LEADER]: Stepping down as leader of term 27
I20260621 08:05:05.958307 10998 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:05.958408 10998 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 27.55, Last appended by leader: 55, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:05.958513 10998 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 27 FOLLOWER]: Advancing to term 28
I20260621 08:05:06.013465 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 28 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260621 08:05:06.013813 10933 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260621 08:05:06.014968 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 28 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 27 index: 55. Preceding OpId from leader: term: 28 index: 55. (term mismatch)
I20260621 08:05:06.015029 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 54
I20260621 08:05:06.015048 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 27.55
I20260621 08:05:06.015062 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:06.015237 10995 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260621 08:05:06.215389 10998 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 28 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:06.215495 10998 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 28 FOLLOWER]: Advancing to term 29
I20260621 08:05:06.216238 10998 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.216387 10998 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 29 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:06.216642 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:06.216660 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:06.216888 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:06.216971 10998 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260621 08:05:06.223526 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 28. Current term is 29. Ops: []
I20260621 08:05:06.223798 10999 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 28.55, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260621 08:05:06.223982 10995 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 LEADER]: Stepping down as leader of term 28
I20260621 08:05:06.224023 10995 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:06.224080 10995 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.224166 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 28 FOLLOWER]: Advancing to term 29
I20260621 08:05:06.290026 10988 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 28 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:06.290132 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 28 FOLLOWER]: Advancing to term 29
I20260621 08:05:06.290832 10988 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.290999 10988 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 29 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:06.291190 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:06.291203 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:06.291321 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 29: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:06.291889 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 29.
I20260621 08:05:06.292063 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:06.292147 10988 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 FOLLOWER]: Leader election won for term 29
I20260621 08:05:06.292204 10988 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:06.292250 10988 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.292729 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 28 to 29, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 29 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:06.362387 10998 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:06.362484 10998 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 29 FOLLOWER]: Advancing to term 30
I20260621 08:05:06.363121 10998 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.363299 10998 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 30 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:06.363519 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:06.363509 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:06.363608 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 29 FOLLOWER]: Advancing to term 30
I20260621 08:05:06.364158 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 30.
I20260621 08:05:06.364331 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:06.364449 10998 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 FOLLOWER]: Leader election won for term 30
I20260621 08:05:06.364502 10998 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:06.364568 10998 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.365011 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 29 to 30, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 30 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:06.389230 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 30 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 29. Current term is 30. Ops: []
I20260621 08:05:06.389554 10988 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260621 08:05:06.389671 10988 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 LEADER]: Stepping down as leader of term 29
I20260621 08:05:06.389703 10988 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:06.389760 10988 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 29.56, Last appended by leader: 56, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.389832 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 29 FOLLOWER]: Advancing to term 30
I20260621 08:05:06.453492 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 30 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 30 index: 56. (index mismatch)
I20260621 08:05:06.453843 10998 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260621 08:05:06.454998 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 30 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 29 index: 56. Preceding OpId from leader: term: 30 index: 56. (term mismatch)
I20260621 08:05:06.455055 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 55
I20260621 08:05:06.455075 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 29.56
I20260621 08:05:06.455090 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:06.455295 11000 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260621 08:05:06.466517 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:06.639602 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 30 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:06.639698 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 30 FOLLOWER]: Advancing to term 31
I20260621 08:05:06.640337 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.640537 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 31 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:06.640758 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:06.640763 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:06.641018 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:06.641135 10995 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260621 08:05:06.644429 10988 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 30 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:06.644488 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 30 FOLLOWER]: Advancing to term 31
I20260621 08:05:06.645071 10988 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.645200 10988 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 31 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:06.645349 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:06.645365 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:06.645434 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 31 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 31: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:06.645576 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:06.645686 10988 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260621 08:05:06.650333 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 31 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 30. Current term is 31. Ops: []
I20260621 08:05:06.650557 11000 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 30.56, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260621 08:05:06.650664 10985 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 LEADER]: Stepping down as leader of term 30
I20260621 08:05:06.650704 10985 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:06.650755 10985 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.650812 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 30 FOLLOWER]: Advancing to term 31
I20260621 08:05:06.751160 10988 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:06.751308 10988 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 31 FOLLOWER]: Advancing to term 32
I20260621 08:05:06.752036 10988 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.752213 10988 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 32 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:06.752430 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 32 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:06.752431 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 32 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:06.752511 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 31 FOLLOWER]: Advancing to term 32
I20260621 08:05:06.752620 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 31 FOLLOWER]: Advancing to term 32
I20260621 08:05:06.753192 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 32.
I20260621 08:05:06.753203 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 32.
I20260621 08:05:06.753432 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:06.753625 10988 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 FOLLOWER]: Leader election won for term 32
I20260621 08:05:06.753675 10988 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:06.753721 10988 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:06.754163 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 30 to 32, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 32 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:06.839785 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 32 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 32 index: 57. (index mismatch)
I20260621 08:05:06.840070 10988 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260621 08:05:06.841123 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 32 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 32 index: 57. (index mismatch)
I20260621 08:05:06.841311 10988 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260621 08:05:07.029224 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:07.029335 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 32 FOLLOWER]: Advancing to term 33
I20260621 08:05:07.030004 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.030194 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 33 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:07.030447 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.030462 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.030772 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:07.030892 10995 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260621 08:05:07.049109 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 32. Current term is 33. Ops: []
I20260621 08:05:07.049355 11001 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 32.57, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260621 08:05:07.049487 11001 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 LEADER]: Stepping down as leader of term 32
I20260621 08:05:07.049518 11001 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:07.049573 11001 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.57, Last appended by leader: 57, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.049655 11001 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 32 FOLLOWER]: Advancing to term 33
I20260621 08:05:07.138036 11000 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 32 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:07.138141 11000 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 32 FOLLOWER]: Advancing to term 33
I20260621 08:05:07.138875 11000 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.139043 11000 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 33 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.139334 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.139307 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 33 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.139431 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 33: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:07.140050 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 33.
I20260621 08:05:07.140244 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:07.140331 11000 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 FOLLOWER]: Leader election won for term 33
I20260621 08:05:07.140384 11000 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:07.140421 11000 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.57, Last appended by leader: 57, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.140898 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 32 to 33, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 33 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:07.155371 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:07.155472 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 33 FOLLOWER]: Advancing to term 34
I20260621 08:05:07.156145 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.156308 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 34 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:07.156524 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 34 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.156531 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 34 candidate_status { last_received { term: 32 index: 57 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.156656 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 33 FOLLOWER]: Advancing to term 34
I20260621 08:05:07.157259 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 34.
I20260621 08:05:07.157537 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:07.157675 10995 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 FOLLOWER]: Leader election won for term 34
I20260621 08:05:07.157801 10995 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:07.157861 10995 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.57, Last appended by leader: 57, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.158308 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 33 to 34, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 34 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:07.260509 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 33. Current term is 34. Ops: []
I20260621 08:05:07.260883 11000 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260621 08:05:07.261018 11000 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 34.58 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 57
I20260621 08:05:07.261052 11000 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 LEADER]: Stepping down as leader of term 33
I20260621 08:05:07.261081 11000 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:07.261135 11000 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 33.58, Last appended by leader: 58, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.261204 11000 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 33 FOLLOWER]: Advancing to term 34
I20260621 08:05:07.266359 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 34 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 33 index: 58. Preceding OpId from leader: term: 34 index: 58. (term mismatch)
I20260621 08:05:07.266424 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 57
I20260621 08:05:07.266438 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 33.58
I20260621 08:05:07.266474 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 34 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:07.266669 10995 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260621 08:05:07.267774 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 34 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 32 index: 57. Preceding OpId from leader: term: 34 index: 58. (index mismatch)
I20260621 08:05:07.267985 11003 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260621 08:05:07.466769 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:07.486625 11000 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 34 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:07.486747 11000 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 34 FOLLOWER]: Advancing to term 35
I20260621 08:05:07.487515 11000 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.487679 11000 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 35 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.487902 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 35 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.487993 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 35 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.488214 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 35 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:07.488389 11000 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Leader election lost for term 35. Reason: could not achieve majority
I20260621 08:05:07.490672 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 34. Current term is 35. Ops: []
I20260621 08:05:07.490890 10995 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 34.58, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260621 08:05:07.490998 10995 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 LEADER]: Stepping down as leader of term 34
I20260621 08:05:07.491024 10995 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:07.491066 10995 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.58, Last appended by leader: 58, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.491133 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 34 FOLLOWER]: Advancing to term 35
I20260621 08:05:07.542116 10987 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 34 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:07.542222 10987 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 34 FOLLOWER]: Advancing to term 35
I20260621 08:05:07.542951 10987 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.543120 10987 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 35 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.543378 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 35 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.543388 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 35 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.543468 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 35: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:07.544203 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 35.
I20260621 08:05:07.544471 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:07.544561 10987 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 FOLLOWER]: Leader election won for term 35
I20260621 08:05:07.544611 10987 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:07.544659 10987 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.58, Last appended by leader: 58, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.545132 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 34 to 35, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 35 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:07.595821 11000 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:07.595935 11000 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 35 FOLLOWER]: Advancing to term 36
I20260621 08:05:07.596657 11000 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.596834 11000 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 36 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.597093 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 36 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.597059 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 36 candidate_status { last_received { term: 34 index: 58 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.597162 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 35 FOLLOWER]: Advancing to term 36
I20260621 08:05:07.597751 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 36 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 36.
I20260621 08:05:07.597947 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 36 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:07.598045 11000 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 FOLLOWER]: Leader election won for term 36
I20260621 08:05:07.598098 11000 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:07.598208 11000 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.58, Last appended by leader: 58, Current term: 36, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.598610 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 35 to 36, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 36 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:07.640657 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 35. Current term is 36. Ops: []
I20260621 08:05:07.640929 10987 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260621 08:05:07.641027 10987 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 36.59 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 58
I20260621 08:05:07.641063 11001 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 LEADER]: Stepping down as leader of term 35
I20260621 08:05:07.641105 11001 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:07.641157 11001 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 35.59, Last appended by leader: 59, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.641243 11001 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 35 FOLLOWER]: Advancing to term 36
I20260621 08:05:07.675251 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 36 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 35 index: 59. Preceding OpId from leader: term: 36 index: 59. (term mismatch)
I20260621 08:05:07.675333 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 58
I20260621 08:05:07.675346 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 35.59
I20260621 08:05:07.675360 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 36 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:07.675598 11000 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260621 08:05:07.676522 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 36 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 34 index: 58. Preceding OpId from leader: term: 36 index: 59. (index mismatch)
I20260621 08:05:07.676730 11000 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260621 08:05:07.869664 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 36 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:07.869781 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 36 FOLLOWER]: Advancing to term 37
I20260621 08:05:07.870412 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.870570 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 37 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:07.870771 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 37 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:07.870776 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 37 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.871030 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:07.871129 10995 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260621 08:05:07.873152 11001 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 36 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:07.873203 11001 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 36 FOLLOWER]: Advancing to term 37
I20260621 08:05:07.873811 11001 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.873946 11001 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 37 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.874109 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 37 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.874130 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 37 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.874173 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 37: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:07.874332 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:07.874413 11001 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260621 08:05:07.887830 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 37 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 36. Current term is 37. Ops: []
I20260621 08:05:07.887830 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 37 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 36. Current term is 37. Ops: []
I20260621 08:05:07.888104 11000 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 36.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260621 08:05:07.888216 10985 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 LEADER]: Stepping down as leader of term 36
I20260621 08:05:07.888240 11004 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 36.59, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260621 08:05:07.888281 10985 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:07.888343 10985 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 36.59, Last appended by leader: 59, Current term: 36, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.888430 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 36 FOLLOWER]: Advancing to term 37
I20260621 08:05:07.995795 11001 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:07.995894 11001 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 37 FOLLOWER]: Advancing to term 38
I20260621 08:05:07.996570 11001 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.996727 11001 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 38 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:07.996992 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 38 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:07.997004 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 38 candidate_status { last_received { term: 36 index: 59 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:07.997099 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 37 FOLLOWER]: Advancing to term 38
I20260621 08:05:07.997112 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 37 FOLLOWER]: Advancing to term 38
I20260621 08:05:07.997782 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 38.
I20260621 08:05:07.997782 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 38.
I20260621 08:05:07.998008 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:07.998103 11001 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 FOLLOWER]: Leader election won for term 38
I20260621 08:05:07.998171 11001 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:07.998229 11001 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 59, Committed index: 59, Last appended: 36.59, Last appended by leader: 59, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:07.998677 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 36 to 38, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 38 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:08.093222 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 38 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 36 index: 59. Preceding OpId from leader: term: 38 index: 60. (index mismatch)
I20260621 08:05:08.093546 11001 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260621 08:05:08.094586 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 38 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 36 index: 59. Preceding OpId from leader: term: 38 index: 60. (index mismatch)
I20260621 08:05:08.094786 11001 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 59, Time since last communication: 0.000s
I20260621 08:05:08.353345 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 38 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:08.353471 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 38 FOLLOWER]: Advancing to term 39
I20260621 08:05:08.354141 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.354418 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 39 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:08.354509 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.354508 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:08.354746 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:08.354835 10995 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260621 08:05:08.370306 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 38. Current term is 39. Ops: []
I20260621 08:05:08.370604 11005 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 38.60, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260621 08:05:08.370744 11005 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 LEADER]: Stepping down as leader of term 38
I20260621 08:05:08.370790 11005 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:08.370862 11005 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.370950 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 38 FOLLOWER]: Advancing to term 39
I20260621 08:05:08.444873 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 38 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:08.444993 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 38 FOLLOWER]: Advancing to term 39
I20260621 08:05:08.445643 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.445786 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 39 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:08.446101 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:08.446096 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.446205 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 39: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:08.446756 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 39.
I20260621 08:05:08.446981 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:08.447124 10985 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 FOLLOWER]: Leader election won for term 39
I20260621 08:05:08.447279 10985 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:08.447371 10985 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.447824 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 38 to 39, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 39 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:08.463289 10995 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:08.463392 10995 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 39 FOLLOWER]: Advancing to term 40
I20260621 08:05:08.464094 10995 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.464251 10995 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 40 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:08.464457 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 40 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.464457 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 40 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:08.464643 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 39 FOLLOWER]: Advancing to term 40
I20260621 08:05:08.465222 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 40.
I20260621 08:05:08.465440 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:08.465548 10995 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 FOLLOWER]: Leader election won for term 40
I20260621 08:05:08.465667 10995 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:08.465718 10995 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.466178 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 39 to 40, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 40 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:08.467013 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:08.534307 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 40 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 39. Current term is 40. Ops: []
I20260621 08:05:08.534641 10985 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260621 08:05:08.534775 10985 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 LEADER]: Stepping down as leader of term 39
I20260621 08:05:08.534802 10985 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:08.534857 10985 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 39.61, Last appended by leader: 61, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.534925 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 39 FOLLOWER]: Advancing to term 40
I20260621 08:05:08.542500 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 40 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 39 index: 61. Preceding OpId from leader: term: 40 index: 61. (term mismatch)
I20260621 08:05:08.542569 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 60
I20260621 08:05:08.542583 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 39.61
I20260621 08:05:08.542596 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 40 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:08.542840 10995 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260621 08:05:08.543768 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 40 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 38 index: 60. Preceding OpId from leader: term: 40 index: 61. (index mismatch)
I20260621 08:05:08.543969 11007 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260621 08:05:08.644670 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 40 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:08.644784 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 40 FOLLOWER]: Advancing to term 41
I20260621 08:05:08.645532 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.645701 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 41 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:08.645959 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:08.645974 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:08.646070 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 40 FOLLOWER]: Advancing to term 41
I20260621 08:05:08.646660 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 41.
I20260621 08:05:08.646845 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 41 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:08.646941 11005 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 FOLLOWER]: Leader election won for term 41
I20260621 08:05:08.647012 11005 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:08.647069 11005 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.61, Last appended by leader: 61, Current term: 41, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.647550 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 40 to 41, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 41 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:08.659834 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 41 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 40. Current term is 41. Ops: []
I20260621 08:05:08.660101 11007 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 40.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260621 08:05:08.660203 11007 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 LEADER]: Stepping down as leader of term 40
I20260621 08:05:08.660233 11007 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:08.660292 11007 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.61, Last appended by leader: 61, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.660388 11007 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 40 FOLLOWER]: Advancing to term 41
I20260621 08:05:08.735123 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 41 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 40 index: 61. Preceding OpId from leader: term: 41 index: 62. (index mismatch)
I20260621 08:05:08.735414 11005 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260621 08:05:08.736435 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 41 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 40 index: 61. Preceding OpId from leader: term: 41 index: 62. (index mismatch)
I20260621 08:05:08.736626 11009 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260621 08:05:08.837646 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 41 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:08.837744 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 41 FOLLOWER]: Advancing to term 42
I20260621 08:05:08.838479 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.838639 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 42 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:08.838873 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:08.838860 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.839119 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 42 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:08.839202 11006 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Leader election lost for term 42. Reason: could not achieve majority
I20260621 08:05:08.858388 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 41. Current term is 42. Ops: []
I20260621 08:05:08.858637 11005 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 41.62, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260621 08:05:08.858743 11005 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 LEADER]: Stepping down as leader of term 41
I20260621 08:05:08.858769 11005 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:08.858826 11005 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 41, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.858893 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 41 FOLLOWER]: Advancing to term 42
I20260621 08:05:08.931423 11007 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 41 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:08.931535 11007 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 41 FOLLOWER]: Advancing to term 42
I20260621 08:05:08.932271 11007 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.932456 11007 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 42 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:08.932693 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.932689 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 42 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:08.932826 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 42: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:08.933454 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 42.
I20260621 08:05:08.933658 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:08.933774 11007 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 FOLLOWER]: Leader election won for term 42
I20260621 08:05:08.933830 11007 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:08.933880 11007 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.934343 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 41 to 42, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 42 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:08.983657 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:08.983755 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 42 FOLLOWER]: Advancing to term 43
I20260621 08:05:08.984457 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.984642 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 43 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:08.984822 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 43 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:08.984885 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 42 FOLLOWER]: Advancing to term 43
I20260621 08:05:08.984858 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 43 candidate_status { last_received { term: 41 index: 62 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:08.985457 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 43.
I20260621 08:05:08.985636 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:08.985729 11006 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 FOLLOWER]: Leader election won for term 43
I20260621 08:05:08.985788 11006 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:08.985858 11006 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 41.62, Last appended by leader: 62, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:08.986269 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 42 to 43, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 43 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:09.036761 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 42. Current term is 43. Ops: []
I20260621 08:05:09.037052 11007 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260621 08:05:09.037174 11007 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 43.63 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 62
I20260621 08:05:09.037209 11007 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 LEADER]: Stepping down as leader of term 42
I20260621 08:05:09.037236 11007 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:09.037294 11007 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 42.63, Last appended by leader: 63, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.037369 11007 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 42 FOLLOWER]: Advancing to term 43
I20260621 08:05:09.063624 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 43 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 42 index: 63. Preceding OpId from leader: term: 43 index: 63. (term mismatch)
I20260621 08:05:09.063714 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 62
I20260621 08:05:09.063733 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 42.63
I20260621 08:05:09.063753 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 43 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:09.063979 11006 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260621 08:05:09.064978 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 43 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 41 index: 62. Preceding OpId from leader: term: 43 index: 63. (index mismatch)
I20260621 08:05:09.065239 11006 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260621 08:05:09.467237 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:09.518571 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 43 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:09.518674 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 43 FOLLOWER]: Advancing to term 44
I20260621 08:05:09.519351 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.519553 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 44 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:09.519608 11007 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 43 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:09.519719 11007 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 43 FOLLOWER]: Advancing to term 44
I20260621 08:05:09.519766 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:09.519830 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:09.520327 11007 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.520480 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 44 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 44: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:09.520543 11007 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 44 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:09.520597 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:09.520699 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:09.520754 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 44 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 44: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:09.520866 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 44 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:09.520869 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 44 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:09.520967 11005 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 44 FOLLOWER]: Leader election lost for term 44. Reason: could not achieve majority
I20260621 08:05:09.520972 11007 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 44 FOLLOWER]: Leader election lost for term 44. Reason: could not achieve majority
I20260621 08:05:09.523079 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 44 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 43. Current term is 44. Ops: []
I20260621 08:05:09.523281 11006 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 43.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260621 08:05:09.523375 11006 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 LEADER]: Stepping down as leader of term 43
I20260621 08:05:09.523406 11006 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:09.523454 11006 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.523566 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 43 FOLLOWER]: Advancing to term 44
I20260621 08:05:09.636392 11007 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 44 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:09.636497 11007 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 44 FOLLOWER]: Advancing to term 45
I20260621 08:05:09.637154 11007 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.637308 11007 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 45 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:09.637529 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 45 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:09.637598 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 44 FOLLOWER]: Advancing to term 45
I20260621 08:05:09.637534 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 45 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:09.637638 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 44 FOLLOWER]: Advancing to term 45
I20260621 08:05:09.638136 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 45.
I20260621 08:05:09.638177 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 45.
I20260621 08:05:09.638336 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:09.638424 11007 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 FOLLOWER]: Leader election won for term 45
I20260621 08:05:09.638535 11007 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:09.638585 11007 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.638968 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 43 to 45, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 45 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:09.714519 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 45 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 45 index: 64. (index mismatch)
I20260621 08:05:09.714804 11007 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260621 08:05:09.716040 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 45 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 45 index: 64. (index mismatch)
I20260621 08:05:09.716313 11011 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260621 08:05:09.816854 11015 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 45 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:09.816972 11015 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 45 FOLLOWER]: Advancing to term 46
I20260621 08:05:09.817878 11015 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.818073 11015 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 46 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:09.818229 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:09.818260 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:09.818522 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 46 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:09.818652 11015 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Leader election lost for term 46. Reason: could not achieve majority
I20260621 08:05:09.821707 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 45. Current term is 46. Ops: []
I20260621 08:05:09.821978 11016 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 45.64, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260621 08:05:09.822089 11016 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 LEADER]: Stepping down as leader of term 45
I20260621 08:05:09.822124 11016 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:09.822176 11016 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 45, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.822255 11016 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 45 FOLLOWER]: Advancing to term 46
I20260621 08:05:09.903826 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 45 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:09.903939 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 45 FOLLOWER]: Advancing to term 46
I20260621 08:05:09.904620 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.904767 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 46 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:09.905071 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:09.905071 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:09.905205 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 46: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:09.905745 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 46.
I20260621 08:05:09.905918 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:09.906001 11006 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 FOLLOWER]: Leader election won for term 46
I20260621 08:05:09.906067 11006 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:09.906128 11006 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.906551 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 45 to 46, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 46 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:09.934617 11015 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:09.934728 11015 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 46 FOLLOWER]: Advancing to term 47
I20260621 08:05:09.935456 11015 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.935619 11015 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 47 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:09.935868 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 47 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:09.935868 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 47 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:09.935988 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 46 FOLLOWER]: Advancing to term 47
I20260621 08:05:09.936568 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 47.
I20260621 08:05:09.936751 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:09.936875 11015 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 FOLLOWER]: Leader election won for term 47
I20260621 08:05:09.936933 11015 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:09.936990 11015 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.937467 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 46 to 47, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 47 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:09.994886 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 46. Current term is 47. Ops: []
I20260621 08:05:09.995239 11006 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260621 08:05:09.995357 11006 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 47.65 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 64
I20260621 08:05:09.995391 11006 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 LEADER]: Stepping down as leader of term 46
I20260621 08:05:09.995419 11006 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:09.995476 11006 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 46.65, Last appended by leader: 65, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:09.995538 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 46 FOLLOWER]: Advancing to term 47
I20260621 08:05:10.045933 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 47 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 46 index: 65. Preceding OpId from leader: term: 47 index: 65. (term mismatch)
I20260621 08:05:10.046018 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 64
I20260621 08:05:10.046031 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 46.65
I20260621 08:05:10.046046 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 47 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:10.046260 11015 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260621 08:05:10.047315 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 47 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 45 index: 64. Preceding OpId from leader: term: 47 index: 65. (index mismatch)
I20260621 08:05:10.047515 11005 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260621 08:05:10.148784 11016 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 47 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:10.148896 11016 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 47 FOLLOWER]: Advancing to term 48
I20260621 08:05:10.149603 11016 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.149775 11016 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 48 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:10.150005 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:10.150002 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:10.150084 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 47 FOLLOWER]: Advancing to term 48
I20260621 08:05:10.150645 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 48.
I20260621 08:05:10.150848 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:10.150939 11016 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 FOLLOWER]: Leader election won for term 48
I20260621 08:05:10.151022 11016 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:10.151086 11016 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.151516 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 47. Current term is 48. Ops: []
I20260621 08:05:10.151603 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 47 to 48, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 48 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:10.151705 11015 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 47.65, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260621 08:05:10.151774 11015 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 48.66 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 65
I20260621 08:05:10.151799 11015 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 LEADER]: Stepping down as leader of term 47
I20260621 08:05:10.151842 11015 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:10.151891 11015 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.151961 11015 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 47 FOLLOWER]: Advancing to term 48
I20260621 08:05:10.256039 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 48 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 47 index: 65. Preceding OpId from leader: term: 48 index: 66. (index mismatch)
I20260621 08:05:10.256320 11016 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260621 08:05:10.257620 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 48 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 47 index: 65. Preceding OpId from leader: term: 48 index: 66. (index mismatch)
I20260621 08:05:10.257825 11017 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260621 08:05:10.358831 10985 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 48 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:10.358958 10985 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 48 FOLLOWER]: Advancing to term 49
I20260621 08:05:10.359685 10985 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.359840 10985 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 49 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:10.360129 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:10.360129 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:10.360275 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 48 FOLLOWER]: Advancing to term 49
I20260621 08:05:10.360854 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 49 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 49.
I20260621 08:05:10.361043 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 49 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:10.361130 10985 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 FOLLOWER]: Leader election won for term 49
I20260621 08:05:10.361181 10985 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:10.361222 10985 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 49, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.361654 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 48 to 49, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 49 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:10.366873 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 49 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 48. Current term is 49. Ops: []
I20260621 08:05:10.367095 11017 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 48.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260621 08:05:10.367179 11017 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 LEADER]: Stepping down as leader of term 48
I20260621 08:05:10.367211 11017 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:10.367290 11017 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.367365 11017 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 48 FOLLOWER]: Advancing to term 49
I20260621 08:05:10.460078 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 49 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 48 index: 66. Preceding OpId from leader: term: 49 index: 67. (index mismatch)
I20260621 08:05:10.460330 10985 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260621 08:05:10.461226 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 49 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 48 index: 66. Preceding OpId from leader: term: 49 index: 67. (index mismatch)
I20260621 08:05:10.461431 11018 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260621 08:05:10.467484 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:10.562083 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 49 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:10.562187 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 49 FOLLOWER]: Advancing to term 50
I20260621 08:05:10.562856 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.563041 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 50 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:10.563259 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 50 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:10.563265 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 50 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:10.563514 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 50 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:10.563606 11005 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Leader election lost for term 50. Reason: could not achieve majority
I20260621 08:05:10.566758 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 49. Current term is 50. Ops: []
I20260621 08:05:10.566962 11006 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 49.67, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260621 08:05:10.567086 11006 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 LEADER]: Stepping down as leader of term 49
I20260621 08:05:10.567119 11006 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:10.567175 11006 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 49.67, Last appended by leader: 67, Current term: 49, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.567279 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 49 FOLLOWER]: Advancing to term 50
I20260621 08:05:10.645875 11017 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 49 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:10.645982 11017 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 49 FOLLOWER]: Advancing to term 50
I20260621 08:05:10.646667 11017 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.646822 11017 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 50 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:10.647058 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 50 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:10.647071 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 50 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:10.647161 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 50: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:10.647720 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 50.
I20260621 08:05:10.647890 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:10.647993 11017 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 FOLLOWER]: Leader election won for term 50
I20260621 08:05:10.648049 11017 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:10.648104 11017 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 49.67, Last appended by leader: 67, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.648525 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 49 to 50, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 50 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:10.677006 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:10.677103 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 50 FOLLOWER]: Advancing to term 51
I20260621 08:05:10.677785 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.677949 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 51 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:10.678167 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 51 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:10.678167 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 51 candidate_status { last_received { term: 49 index: 67 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:10.678278 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 50 FOLLOWER]: Advancing to term 51
I20260621 08:05:10.678825 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 51.
I20260621 08:05:10.678989 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:10.679075 11005 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 FOLLOWER]: Leader election won for term 51
I20260621 08:05:10.679193 11005 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:10.679267 11005 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 49.67, Last appended by leader: 67, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.679744 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 50 to 51, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 51 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:10.729023 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 50. Current term is 51. Ops: []
I20260621 08:05:10.729321 11017 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260621 08:05:10.729425 11017 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 51.68 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 67
I20260621 08:05:10.729456 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 LEADER]: Stepping down as leader of term 50
I20260621 08:05:10.729488 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:10.729550 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.68, Last appended by leader: 68, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.729641 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 50 FOLLOWER]: Advancing to term 51
I20260621 08:05:10.766127 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 51 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 50 index: 68. Preceding OpId from leader: term: 51 index: 68. (term mismatch)
I20260621 08:05:10.766199 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 67
I20260621 08:05:10.766212 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 50.68
I20260621 08:05:10.766227 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 51 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:10.766414 11005 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260621 08:05:10.767371 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 51 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 49 index: 67. Preceding OpId from leader: term: 51 index: 68. (index mismatch)
I20260621 08:05:10.767578 11020 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260621 08:05:10.949438 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 51 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:10.949542 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 51 FOLLOWER]: Advancing to term 52
I20260621 08:05:10.950202 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.950361 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 52 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:10.950637 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:10.950662 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:10.950911 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 52 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:10.950992 11006 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 52 FOLLOWER]: Leader election lost for term 52. Reason: could not achieve majority
I20260621 08:05:10.955178 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 51 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:10.955250 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 51 FOLLOWER]: Advancing to term 52
I20260621 08:05:10.955848 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.955991 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 52 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:10.956128 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:10.956146 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 52 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:10.956228 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 52 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 52: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:10.956425 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 52 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:10.956511 11011 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 52 FOLLOWER]: Leader election lost for term 52. Reason: could not achieve majority
I20260621 08:05:10.958279 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 52 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 51. Current term is 52. Ops: []
I20260621 08:05:10.958462 11019 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 51.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 08:05:10.958556 11019 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 LEADER]: Stepping down as leader of term 51
I20260621 08:05:10.958588 11019 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:10.958647 11019 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:10.958720 11019 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 51 FOLLOWER]: Advancing to term 52
I20260621 08:05:11.065762 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 52 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:11.065868 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 52 FOLLOWER]: Advancing to term 53
I20260621 08:05:11.066581 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.066733 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 53 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.066996 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 53 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.067013 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 53 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.067094 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 52 FOLLOWER]: Advancing to term 53
I20260621 08:05:11.067101 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 52 FOLLOWER]: Advancing to term 53
I20260621 08:05:11.067675 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 53.
I20260621 08:05:11.067798 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 53.
I20260621 08:05:11.067868 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:11.067951 11006 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 FOLLOWER]: Leader election won for term 53
I20260621 08:05:11.068069 11006 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.068143 11006 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.068576 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 51 to 53, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 53 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:11.178216 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 53 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:11.178318 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 53 FOLLOWER]: Advancing to term 54
I20260621 08:05:11.179056 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.179104 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 53 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 51 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260621 08:05:11.179198 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 54 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:11.179425 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 54 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.179505 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 53 FOLLOWER]: Advancing to term 54
I20260621 08:05:11.179463 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 54 candidate_status { last_received { term: 51 index: 68 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.179452 11006 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 08:05:11.180123 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 54.
I20260621 08:05:11.180204 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 54 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 53. Current term is 54. Ops: [53.69-53.69]
I20260621 08:05:11.180348 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:11.180389 11006 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 51.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 08:05:11.180454 11011 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 FOLLOWER]: Leader election won for term 54
I20260621 08:05:11.180464 11006 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 LEADER]: Stepping down as leader of term 53
I20260621 08:05:11.180513 11011 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:11.180516 11006 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.180564 11011 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 51.68, Last appended by leader: 68, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.180586 11006 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 53.69, Last appended by leader: 69, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.180644 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 53 FOLLOWER]: Advancing to term 54
I20260621 08:05:11.180971 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 53 to 54, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 54 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:11.267478 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 54 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 54 index: 69. (term mismatch)
I20260621 08:05:11.267558 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 68
I20260621 08:05:11.267571 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 53.69
I20260621 08:05:11.267585 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 54 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:11.267796 11011 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 08:05:11.268813 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 54 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 51 index: 68. Preceding OpId from leader: term: 54 index: 69. (index mismatch)
I20260621 08:05:11.269035 11017 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260621 08:05:11.369683 11019 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 54 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:11.369793 11019 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 54 FOLLOWER]: Advancing to term 55
I20260621 08:05:11.370517 11019 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.370682 11019 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 55 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.370890 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 55 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.370891 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 55 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.371140 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:11.371315 11019 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260621 08:05:11.382848 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 54. Current term is 55. Ops: []
I20260621 08:05:11.383208 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 54.69, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260621 08:05:11.383356 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 LEADER]: Stepping down as leader of term 54
I20260621 08:05:11.383505 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:11.383603 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 54.69, Last appended by leader: 69, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.383697 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 54 FOLLOWER]: Advancing to term 55
I20260621 08:05:11.459863 11006 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 54 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:11.459965 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 54 FOLLOWER]: Advancing to term 55
I20260621 08:05:11.461483 11006 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.461627 11006 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 55 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.461867 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 55 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.461874 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 55 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.461972 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 55: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:11.462550 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 55 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 55.
I20260621 08:05:11.462707 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 55 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:11.462823 11006 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 FOLLOWER]: Leader election won for term 55
I20260621 08:05:11.462903 11006 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.462960 11006 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 54.69, Last appended by leader: 69, Current term: 55, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.463382 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 54 to 55, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 55 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:11.467664 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:11.505800 11019 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:11.505906 11019 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 55 FOLLOWER]: Advancing to term 56
I20260621 08:05:11.506592 11019 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.506762 11019 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 56 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.506960 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 56 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.506975 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 56 candidate_status { last_received { term: 54 index: 69 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.507073 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 55 FOLLOWER]: Advancing to term 56
I20260621 08:05:11.507640 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 56.
I20260621 08:05:11.507825 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:11.507948 11019 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 FOLLOWER]: Leader election won for term 56
I20260621 08:05:11.508003 11019 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:11.508051 11019 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 54.69, Last appended by leader: 69, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.508563 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 55 to 56, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 56 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:11.549880 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 56 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 55. Current term is 56. Ops: []
I20260621 08:05:11.550211 11006 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260621 08:05:11.550341 11006 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 LEADER]: Stepping down as leader of term 55
I20260621 08:05:11.550377 11006 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.550436 11006 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 55.70, Last appended by leader: 70, Current term: 55, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.550514 11006 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 55 FOLLOWER]: Advancing to term 56
I20260621 08:05:11.593031 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 56 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 54 index: 69. Preceding OpId from leader: term: 56 index: 70. (index mismatch)
I20260621 08:05:11.593312 11019 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260621 08:05:11.594411 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 56 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 55 index: 70. Preceding OpId from leader: term: 56 index: 70. (term mismatch)
I20260621 08:05:11.594470 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 69
I20260621 08:05:11.594496 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 55.70
I20260621 08:05:11.594517 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 56 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:11.594666 11005 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260621 08:05:11.695418 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 56 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:11.695547 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 56 FOLLOWER]: Advancing to term 57
I20260621 08:05:11.696159 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.696312 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 57 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:11.696537 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 57 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.696535 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 57 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.696862 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 57 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:11.696972 11011 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Leader election lost for term 57. Reason: could not achieve majority
I20260621 08:05:11.699263 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 56. Current term is 57. Ops: []
I20260621 08:05:11.699525 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 56.70, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260621 08:05:11.699636 11019 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 LEADER]: Stepping down as leader of term 56
I20260621 08:05:11.699697 11019 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:11.699757 11019 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 56.70, Last appended by leader: 70, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.699841 11019 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 56 FOLLOWER]: Advancing to term 57
I20260621 08:05:11.782200 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 56 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:11.782305 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 56 FOLLOWER]: Advancing to term 57
I20260621 08:05:11.783052 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.783195 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 57 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.783463 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 57 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.783536 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 57: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:11.783458 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 57 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.784149 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 57 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 57.
I20260621 08:05:11.784336 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 57 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:11.784448 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 FOLLOWER]: Leader election won for term 57
I20260621 08:05:11.784518 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.784574 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 56.70, Last appended by leader: 70, Current term: 57, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.785041 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 56 to 57, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 57 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:11.809726 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:11.809826 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 57 FOLLOWER]: Advancing to term 58
I20260621 08:05:11.810452 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.810608 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 58 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:11.810796 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 58 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:11.810806 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 58 candidate_status { last_received { term: 56 index: 70 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.810881 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 57 FOLLOWER]: Advancing to term 58
I20260621 08:05:11.811492 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 58.
I20260621 08:05:11.811659 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:11.811750 11011 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 FOLLOWER]: Leader election won for term 58
I20260621 08:05:11.811805 11011 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:11.811861 11011 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 56.70, Last appended by leader: 70, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.812292 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 57 to 58, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 58 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:11.869481 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 58 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 57. Current term is 58. Ops: []
I20260621 08:05:11.869751 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260621 08:05:11.869869 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 LEADER]: Stepping down as leader of term 57
I20260621 08:05:11.869900 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:11.869967 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 57.71, Last appended by leader: 71, Current term: 57, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.870038 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 57 FOLLOWER]: Advancing to term 58
I20260621 08:05:11.894835 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 58 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 57 index: 71. Preceding OpId from leader: term: 58 index: 71. (term mismatch)
I20260621 08:05:11.894913 10724 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 70
I20260621 08:05:11.894927 10724 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 57.71
I20260621 08:05:11.894939 10724 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 58 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:11.895228 11011 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260621 08:05:11.896193 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 58 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 56 index: 70. Preceding OpId from leader: term: 58 index: 71. (index mismatch)
I20260621 08:05:11.896394 11011 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260621 08:05:11.997532 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 58 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:11.997641 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 58 FOLLOWER]: Advancing to term 59
I20260621 08:05:11.998373 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:11.998533 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 59 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:11.998811 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 59 candidate_status { last_received { term: 58 index: 71 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:11.998811 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 59 candidate_status { last_received { term: 58 index: 71 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:11.998931 10724 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 58 FOLLOWER]: Advancing to term 59
I20260621 08:05:11.999491 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 59.
I20260621 08:05:11.999671 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:11.999812 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 FOLLOWER]: Leader election won for term 59
I20260621 08:05:11.999893 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:11.999944 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 58.71, Last appended by leader: 71, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.000463 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 58 to 59, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 59 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:12.013367 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 59 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 58. Current term is 59. Ops: []
I20260621 08:05:12.013610 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 58.71, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260621 08:05:12.013707 11022 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 LEADER]: Stepping down as leader of term 58
I20260621 08:05:12.013751 11022 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:12.013818 11022 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 58.71, Last appended by leader: 71, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.013890 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 58 FOLLOWER]: Advancing to term 59
I20260621 08:05:12.081878 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 59 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 58 index: 71. Preceding OpId from leader: term: 59 index: 72. (index mismatch)
I20260621 08:05:12.082149 11023 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260621 08:05:12.083190 10724 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 59 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 58 index: 71. Preceding OpId from leader: term: 59 index: 72. (index mismatch)
I20260621 08:05:12.083384 11019 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260621 08:05:12.184274 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 59 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:12.184402 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 59 FOLLOWER]: Advancing to term 60
I20260621 08:05:12.185098 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.185284 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 60 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:12.185530 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:12.185565 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:12.185815 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:12.185917 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260621 08:05:12.208406 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 59. Current term is 60. Ops: []
I20260621 08:05:12.208680 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 59.72, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260621 08:05:12.208818 11005 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 LEADER]: Stepping down as leader of term 59
I20260621 08:05:12.208866 11005 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:12.208913 11005 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.208986 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 59 FOLLOWER]: Advancing to term 60
I20260621 08:05:12.266192 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 59 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:12.266291 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 59 FOLLOWER]: Advancing to term 60
I20260621 08:05:12.266933 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.267105 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 60 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:12.267330 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:12.267333 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 60 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:12.267465 10724 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 60: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:12.267961 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 60 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 60.
I20260621 08:05:12.268132 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 60 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:12.268220 11022 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 FOLLOWER]: Leader election won for term 60
I20260621 08:05:12.268277 11022 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:12.268383 11022 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 60, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.268798 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 59 to 60, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 60 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:12.296268 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:12.296365 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 60 FOLLOWER]: Advancing to term 61
I20260621 08:05:12.297035 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.297186 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 61 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:12.297417 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 61 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:12.297508 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 60 FOLLOWER]: Advancing to term 61
I20260621 08:05:12.297488 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 61 candidate_status { last_received { term: 59 index: 72 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:12.298141 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 61.
I20260621 08:05:12.298316 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:12.298411 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 FOLLOWER]: Leader election won for term 61
I20260621 08:05:12.298462 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:12.298509 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 59.72, Last appended by leader: 72, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.298964 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 60 to 61, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 61 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:12.375579 10724 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 60. Current term is 61. Ops: []
I20260621 08:05:12.375859 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260621 08:05:12.375998 11022 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 61.73 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 72
I20260621 08:05:12.376034 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 LEADER]: Stepping down as leader of term 60
I20260621 08:05:12.376085 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:12.376144 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 60.73, Last appended by leader: 73, Current term: 60, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.376226 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 60 FOLLOWER]: Advancing to term 61
I20260621 08:05:12.376921 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 61 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 60 index: 73. Preceding OpId from leader: term: 61 index: 73. (term mismatch)
I20260621 08:05:12.376972 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 72
I20260621 08:05:12.376994 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 60.73
I20260621 08:05:12.377012 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 61 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:12.377213 11021 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260621 08:05:12.378074 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 61 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 59 index: 72. Preceding OpId from leader: term: 61 index: 73. (index mismatch)
I20260621 08:05:12.378247 11006 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260621 08:05:12.467870 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:12.557874 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 61 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:12.557968 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 61 FOLLOWER]: Advancing to term 62
I20260621 08:05:12.558589 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.558739 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 62 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:12.558959 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:12.558967 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:12.559177 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:12.559286 11005 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20260621 08:05:12.567688 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 62 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 61. Current term is 62. Ops: []
I20260621 08:05:12.567946 11024 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 61.73, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260621 08:05:12.568059 11024 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 LEADER]: Stepping down as leader of term 61
I20260621 08:05:12.568091 11024 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:12.568152 11024 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.568236 11024 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 61 FOLLOWER]: Advancing to term 62
I20260621 08:05:12.659914 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 61 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:12.660030 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 61 FOLLOWER]: Advancing to term 62
I20260621 08:05:12.660674 11005 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:12.660745 11005 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 62 FOLLOWER]: Advancing to term 63
I20260621 08:05:12.660843 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.661221 10724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:12.661473 11005 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.661604 11005 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 63 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:12.661033 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 62 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:12.661784 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 63 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:12.661880 10724 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 62 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 62.
I20260621 08:05:12.661949 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 62 FOLLOWER]: Advancing to term 63
I20260621 08:05:12.661954 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 62 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:12.662042 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 62 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:12.662096 10802 raft_consensus.cc:2368] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 for earlier term 62. Current term is 63.
I20260621 08:05:12.662147 11011 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 FOLLOWER]: Leader election won for term 62
I20260621 08:05:12.662179 11011 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:12.662225 11011 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 62, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.661784 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 63 candidate_status { last_received { term: 61 index: 73 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:12.662542 10842 leader_election.cc:400] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 62 election: Vote denied by peer 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955) with higher term. Message: Invalid argument: T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 for earlier term 62. Current term is 63.
I20260621 08:05:12.663100 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 63.
I20260621 08:05:12.663290 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:12.663370 11005 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 FOLLOWER]: Leader election won for term 63
I20260621 08:05:12.663424 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 61 to 62, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 62 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:12.663417 11005 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:12.663548 11005 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 61.73, Last appended by leader: 73, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.664207 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 62 to 63, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 63 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:12.739511 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 62. Current term is 63. Ops: []
I20260621 08:05:12.739804 11011 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260621 08:05:12.739917 11011 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 63.74 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 73
I20260621 08:05:12.739941 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 LEADER]: Stepping down as leader of term 62
I20260621 08:05:12.739955 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:12.740000 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 62.74, Last appended by leader: 74, Current term: 62, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.740082 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 62 FOLLOWER]: Advancing to term 63
I20260621 08:05:12.743268 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 63 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 62 index: 74. Preceding OpId from leader: term: 63 index: 74. (term mismatch)
I20260621 08:05:12.743335 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 73
I20260621 08:05:12.743350 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 62.74
I20260621 08:05:12.743363 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 63 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:12.743579 11005 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260621 08:05:12.744647 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 63 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 61 index: 73. Preceding OpId from leader: term: 63 index: 74. (index mismatch)
I20260621 08:05:12.744926 11025 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260621 08:05:12.946331 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 63 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:12.946467 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 63 FOLLOWER]: Advancing to term 64
I20260621 08:05:12.947110 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.947320 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 64 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:12.947561 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:12.947618 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:12.947808 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:12.947909 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20260621 08:05:12.967201 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 63. Current term is 64. Ops: []
I20260621 08:05:12.967512 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 63.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260621 08:05:12.967635 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 LEADER]: Stepping down as leader of term 63
I20260621 08:05:12.967675 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:12.967736 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.74, Last appended by leader: 74, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:12.967818 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 63 FOLLOWER]: Advancing to term 64
I20260621 08:05:13.056819 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 63 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:13.056927 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 63 FOLLOWER]: Advancing to term 64
I20260621 08:05:13.057634 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.057808 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 64 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:13.058017 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.058017 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 64 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.058130 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 64: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:13.058662 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 64 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 64.
I20260621 08:05:13.058823 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 64 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:13.058898 11011 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 FOLLOWER]: Leader election won for term 64
I20260621 08:05:13.058946 11011 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:13.058982 11011 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.74, Last appended by leader: 74, Current term: 64, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.059432 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 63 to 64, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 64 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:13.066254 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:13.066321 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 64 FOLLOWER]: Advancing to term 65
I20260621 08:05:13.066891 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.067029 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 65 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:13.067202 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 65 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.067289 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 64 FOLLOWER]: Advancing to term 65
I20260621 08:05:13.067204 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 65 candidate_status { last_received { term: 63 index: 74 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:13.067836 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 65 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 65.
I20260621 08:05:13.068025 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 65 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:13.068122 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 FOLLOWER]: Leader election won for term 65
I20260621 08:05:13.068179 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:13.068228 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 63.74, Last appended by leader: 74, Current term: 65, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.068596 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 64 to 65, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 65 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:13.140969 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 65 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 64. Current term is 65. Ops: []
I20260621 08:05:13.141304 11011 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260621 08:05:13.141422 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 LEADER]: Stepping down as leader of term 64
I20260621 08:05:13.141441 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:13.141502 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 64.75, Last appended by leader: 75, Current term: 64, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.141575 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 64 FOLLOWER]: Advancing to term 65
I20260621 08:05:13.148947 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 65 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 64 index: 75. Preceding OpId from leader: term: 65 index: 75. (term mismatch)
I20260621 08:05:13.149017 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 74
I20260621 08:05:13.149030 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 64.75
I20260621 08:05:13.149044 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 65 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:13.149252 11021 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260621 08:05:13.150190 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 65 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 63 index: 74. Preceding OpId from leader: term: 65 index: 75. (index mismatch)
I20260621 08:05:13.150429 11024 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260621 08:05:13.333652 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 65 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:13.333751 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 65 FOLLOWER]: Advancing to term 66
I20260621 08:05:13.334411 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.334578 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 66 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:13.334790 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 66 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:13.334794 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 66 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.335071 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 66 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:13.335155 11023 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Leader election lost for term 66. Reason: could not achieve majority
I20260621 08:05:13.342144 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 65. Current term is 66. Ops: []
I20260621 08:05:13.342446 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 65.75, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260621 08:05:13.342576 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 LEADER]: Stepping down as leader of term 65
I20260621 08:05:13.342610 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:13.342658 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 65.75, Last appended by leader: 75, Current term: 65, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.342721 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 65 FOLLOWER]: Advancing to term 66
I20260621 08:05:13.437463 11011 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 65 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:13.437565 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 65 FOLLOWER]: Advancing to term 66
I20260621 08:05:13.438205 11011 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.438361 11011 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 66 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:13.438584 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 66 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.438658 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 66: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:13.438614 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 66 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.439301 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 66.
I20260621 08:05:13.439463 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 66 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:13.439554 11011 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 FOLLOWER]: Leader election won for term 66
I20260621 08:05:13.439615 11011 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:13.439666 11011 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 65.75, Last appended by leader: 75, Current term: 66, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.440081 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 65 to 66, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 66 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:13.468112 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:13.480592 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:13.480687 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 66 FOLLOWER]: Advancing to term 67
I20260621 08:05:13.481365 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.481532 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 67 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:13.481739 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 67 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:13.481748 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 67 candidate_status { last_received { term: 65 index: 75 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.481853 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 66 FOLLOWER]: Advancing to term 67
I20260621 08:05:13.482401 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 67.
I20260621 08:05:13.482570 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:13.482669 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 FOLLOWER]: Leader election won for term 67
I20260621 08:05:13.482790 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:13.482869 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 65.75, Last appended by leader: 75, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.483314 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 66 to 67, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 67 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:13.521636 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 67 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 66. Current term is 67. Ops: []
I20260621 08:05:13.521952 11011 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260621 08:05:13.522079 11011 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 LEADER]: Stepping down as leader of term 66
I20260621 08:05:13.522104 11011 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:13.522156 11011 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 66.76, Last appended by leader: 76, Current term: 66, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.522229 11011 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 66 FOLLOWER]: Advancing to term 67
I20260621 08:05:13.582767 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 67 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 65 index: 75. Preceding OpId from leader: term: 67 index: 76. (index mismatch)
I20260621 08:05:13.583081 11023 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260621 08:05:13.583560 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 67 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 66 index: 76. Preceding OpId from leader: term: 67 index: 76. (term mismatch)
I20260621 08:05:13.583608 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 75
I20260621 08:05:13.583624 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 66.76
I20260621 08:05:13.583642 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 67 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:13.583865 11023 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260621 08:05:13.866286 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 67 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:13.866394 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 67 FOLLOWER]: Advancing to term 68
I20260621 08:05:13.867164 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.867343 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 68 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:13.867597 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 68 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:13.867597 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 68 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.867873 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 68 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:13.867967 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 68 FOLLOWER]: Leader election lost for term 68. Reason: could not achieve majority
I20260621 08:05:13.872807 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 67 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:13.872872 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 67 FOLLOWER]: Advancing to term 68
I20260621 08:05:13.873481 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.873620 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 68 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:13.873790 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 68 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.873808 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 68 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.873884 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 68 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 68: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:13.874020 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 68 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:13.874095 11022 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 68 FOLLOWER]: Leader election lost for term 68. Reason: could not achieve majority
I20260621 08:05:13.884785 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 68 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 67. Current term is 68. Ops: []
I20260621 08:05:13.885015 11028 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 67.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260621 08:05:13.885142 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 LEADER]: Stepping down as leader of term 67
I20260621 08:05:13.885191 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:13.885251 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 67.76, Last appended by leader: 76, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.885337 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 67 FOLLOWER]: Advancing to term 68
I20260621 08:05:13.998502 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 68 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:13.998612 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 68 FOLLOWER]: Advancing to term 69
I20260621 08:05:13.999315 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:13.999477 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 69 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:13.999677 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 69 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:13.999748 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 68 FOLLOWER]: Advancing to term 69
I20260621 08:05:13.999686 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 69 candidate_status { last_received { term: 67 index: 76 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:13.999842 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 68 FOLLOWER]: Advancing to term 69
I20260621 08:05:14.000312 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 69.
I20260621 08:05:14.000394 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 69.
I20260621 08:05:14.000509 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:14.000582 11022 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 FOLLOWER]: Leader election won for term 69
I20260621 08:05:14.000626 11022 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:14.000689 11022 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 67.76, Last appended by leader: 76, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.001108 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 67 to 69, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 69 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:14.087621 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 69 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 67 index: 76. Preceding OpId from leader: term: 69 index: 77. (index mismatch)
I20260621 08:05:14.087900 11022 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260621 08:05:14.089048 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 69 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 67 index: 76. Preceding OpId from leader: term: 69 index: 77. (index mismatch)
I20260621 08:05:14.089249 11033 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260621 08:05:14.189635 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 69 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:14.189738 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 69 FOLLOWER]: Advancing to term 70
I20260621 08:05:14.189973 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 69 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:14.190042 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 69 FOLLOWER]: Advancing to term 70
I20260621 08:05:14.190438 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.190579 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 70 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:14.190634 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.190798 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 70 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:14.190814 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 70 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:14.190809 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 70 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:14.190902 10802 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 70: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:14.190915 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 70 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:14.190985 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 70 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 70: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:14.190973 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 70 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:14.191089 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 70 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:14.191149 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 70 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:14.191191 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 70 FOLLOWER]: Leader election lost for term 70. Reason: could not achieve majority
I20260621 08:05:14.191277 11023 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Leader election lost for term 70. Reason: could not achieve majority
I20260621 08:05:14.207692 10802 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 69. Current term is 70. Ops: []
I20260621 08:05:14.207973 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 69.77, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260621 08:05:14.208076 11022 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 LEADER]: Stepping down as leader of term 69
I20260621 08:05:14.208107 11022 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:14.208156 11022 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 69.77, Last appended by leader: 77, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.208244 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 69 FOLLOWER]: Advancing to term 70
I20260621 08:05:14.305289 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:14.305408 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 70 FOLLOWER]: Advancing to term 71
I20260621 08:05:14.306064 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.306236 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 71 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:14.306466 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 71 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:14.306536 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 70 FOLLOWER]: Advancing to term 71
I20260621 08:05:14.306481 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 71 candidate_status { last_received { term: 69 index: 77 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:14.306599 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 70 FOLLOWER]: Advancing to term 71
I20260621 08:05:14.307097 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 71.
I20260621 08:05:14.307173 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 71.
I20260621 08:05:14.307313 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:14.307385 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 FOLLOWER]: Leader election won for term 71
I20260621 08:05:14.307438 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:14.307485 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 69.77, Last appended by leader: 77, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.307888 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 69 to 71, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 71 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:14.387499 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 71 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 69 index: 77. Preceding OpId from leader: term: 71 index: 78. (index mismatch)
I20260621 08:05:14.387784 11023 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260621 08:05:14.388757 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 71 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 69 index: 77. Preceding OpId from leader: term: 71 index: 78. (index mismatch)
I20260621 08:05:14.388922 11023 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260621 08:05:14.468366 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:14.489202 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 71 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:14.489303 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 71 FOLLOWER]: Advancing to term 72
I20260621 08:05:14.490157 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.490309 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 72 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:14.490474 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 72 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:14.490492 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 72 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:14.490695 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 72 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:14.490803 11022 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Leader election lost for term 72. Reason: could not achieve majority
I20260621 08:05:14.499295 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 71. Current term is 72. Ops: []
I20260621 08:05:14.499503 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 71.78, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260621 08:05:14.499610 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 LEADER]: Stepping down as leader of term 71
I20260621 08:05:14.499640 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:14.499699 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 71.78, Last appended by leader: 78, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.499764 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 71 FOLLOWER]: Advancing to term 72
I20260621 08:05:14.590258 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 71 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:14.590366 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 71 FOLLOWER]: Advancing to term 72
I20260621 08:05:14.591017 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.591177 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 72 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:14.591463 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 72 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:14.591463 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 72 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:14.591575 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 72: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:14.592228 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 72 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 72.
I20260621 08:05:14.592473 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 72 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:14.592557 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 FOLLOWER]: Leader election won for term 72
I20260621 08:05:14.592651 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:14.592696 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 71.78, Last appended by leader: 78, Current term: 72, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.593156 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 71 to 72, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 72 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:14.608930 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:14.609031 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 72 FOLLOWER]: Advancing to term 73
I20260621 08:05:14.609653 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.609800 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 73 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:14.609997 10802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 73 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:14.610018 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 73 candidate_status { last_received { term: 71 index: 78 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:14.610064 10802 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 72 FOLLOWER]: Advancing to term 73
I20260621 08:05:14.610647 10802 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 73.
I20260621 08:05:14.610853 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:14.610947 11022 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 FOLLOWER]: Leader election won for term 73
I20260621 08:05:14.611034 11022 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:14.611083 11022 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 71.78, Last appended by leader: 78, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.611578 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 72 to 73, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 73 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:14.686892 10802 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 73 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 71 index: 78. Preceding OpId from leader: term: 73 index: 79. (index mismatch)
I20260621 08:05:14.687203 11022 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260621 08:05:14.687865 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 73 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 72. Current term is 73. Ops: []
I20260621 08:05:14.688073 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260621 08:05:14.688170 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 LEADER]: Stepping down as leader of term 72
I20260621 08:05:14.688197 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:14.688243 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 72.79, Last appended by leader: 79, Current term: 72, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.688304 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 72 FOLLOWER]: Advancing to term 73
I20260621 08:05:14.689127 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 73 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 72 index: 79. Preceding OpId from leader: term: 73 index: 79. (term mismatch)
I20260621 08:05:14.689170 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 78
I20260621 08:05:14.689188 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 72.79
I20260621 08:05:14.689205 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 73 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:14.689366 11033 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260621 08:05:14.971953 11034 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 73 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:14.972055 11034 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 73 FOLLOWER]: Advancing to term 74
I20260621 08:05:14.972756 11034 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.972908 11034 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 74 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:14.973131 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 74 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:14.973141 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 74 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:14.973408 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:14.973503 11034 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260621 08:05:14.977612 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 73. Current term is 74. Ops: []
I20260621 08:05:14.977823 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 73.79, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260621 08:05:14.977932 11022 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 LEADER]: Stepping down as leader of term 73
I20260621 08:05:14.977965 11022 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:14.978014 11022 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 73.79, Last appended by leader: 79, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:14.978087 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 73 FOLLOWER]: Advancing to term 74
I20260621 08:05:15.032023 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 73 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:15.032121 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 73 FOLLOWER]: Advancing to term 74
I20260621 08:05:15.032766 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.032933 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 74 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.033142 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 74 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.033152 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 74 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:15.033293 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 74: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:15.033830 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 74.
I20260621 08:05:15.034056 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 74 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:15.034168 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 FOLLOWER]: Leader election won for term 74
I20260621 08:05:15.034262 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.034303 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 73.79, Last appended by leader: 79, Current term: 74, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.034715 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 73 to 74, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 74 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:15.087869 11034 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:15.087967 11034 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 74 FOLLOWER]: Advancing to term 75
I20260621 08:05:15.088645 11034 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.088788 11034 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 75 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.089010 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 75 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.089013 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 75 candidate_status { last_received { term: 73 index: 79 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:15.089125 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 74 FOLLOWER]: Advancing to term 75
I20260621 08:05:15.089658 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 75 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 75.
I20260621 08:05:15.089828 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 75 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:15.089926 11034 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 FOLLOWER]: Leader election won for term 75
I20260621 08:05:15.089994 11034 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:15.090056 11034 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 73.79, Last appended by leader: 79, Current term: 75, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.090535 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 74 to 75, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 75 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:15.112776 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 75 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 74. Current term is 75. Ops: []
I20260621 08:05:15.113062 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260621 08:05:15.113183 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 LEADER]: Stepping down as leader of term 74
I20260621 08:05:15.113209 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.113257 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 74.80, Last appended by leader: 80, Current term: 74, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.113310 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 74 FOLLOWER]: Advancing to term 75
I20260621 08:05:15.194968 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 75 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 73 index: 79. Preceding OpId from leader: term: 75 index: 80. (index mismatch)
I20260621 08:05:15.195300 11034 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260621 08:05:15.196237 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 75 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 74 index: 80. Preceding OpId from leader: term: 75 index: 80. (term mismatch)
I20260621 08:05:15.196288 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 79
I20260621 08:05:15.196305 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 74.80
I20260621 08:05:15.196321 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 75 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:15.196472 11034 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260621 08:05:15.391923 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 75 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:15.392025 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 75 FOLLOWER]: Advancing to term 76
I20260621 08:05:15.392679 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.392839 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 76 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:15.393066 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 76 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:15.393066 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 76 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:15.393347 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 76 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:15.393464 11022 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Leader election lost for term 76. Reason: could not achieve majority
I20260621 08:05:15.415764 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 75. Current term is 76. Ops: []
I20260621 08:05:15.416018 11036 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 75.80, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260621 08:05:15.416158 11036 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 LEADER]: Stepping down as leader of term 75
I20260621 08:05:15.416198 11036 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:15.416262 11036 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 75.80, Last appended by leader: 80, Current term: 75, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.416357 11036 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 75 FOLLOWER]: Advancing to term 76
I20260621 08:05:15.468626 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:15.512370 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 75 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:15.512495 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 75 FOLLOWER]: Advancing to term 76
I20260621 08:05:15.513108 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.513265 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 76 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.513515 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 76 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.513526 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 76 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:15.513608 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 76: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:15.514150 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 76.
I20260621 08:05:15.514385 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:15.514480 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 FOLLOWER]: Leader election won for term 76
I20260621 08:05:15.514539 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.514606 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 75.80, Last appended by leader: 80, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.515064 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 75 to 76, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 76 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:15.536299 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:15.536391 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 76 FOLLOWER]: Advancing to term 77
I20260621 08:05:15.537002 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.537156 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 77 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:15.537364 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 77 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:15.537364 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 77 candidate_status { last_received { term: 75 index: 80 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:15.537472 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 76 FOLLOWER]: Advancing to term 77
I20260621 08:05:15.538026 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 77 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 77.
I20260621 08:05:15.538193 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 77 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:15.538285 11022 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 FOLLOWER]: Leader election won for term 77
I20260621 08:05:15.538411 11022 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:15.538466 11022 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 75.80, Last appended by leader: 80, Current term: 77, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.538890 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 76 to 77, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 77 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:15.595466 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 77 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 76. Current term is 77. Ops: []
I20260621 08:05:15.595741 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260621 08:05:15.595845 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 LEADER]: Stepping down as leader of term 76
I20260621 08:05:15.595877 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.595937 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 76.81, Last appended by leader: 81, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.595999 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 76 FOLLOWER]: Advancing to term 77
I20260621 08:05:15.616673 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 77 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 76 index: 81. Preceding OpId from leader: term: 77 index: 81. (term mismatch)
I20260621 08:05:15.616801 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 80
I20260621 08:05:15.616818 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 76.81
I20260621 08:05:15.616833 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 77 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:15.617117 11022 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260621 08:05:15.618219 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 77 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 75 index: 80. Preceding OpId from leader: term: 77 index: 81. (index mismatch)
I20260621 08:05:15.618423 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260621 08:05:15.719725 11036 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 77 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:15.719817 11036 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 77 FOLLOWER]: Advancing to term 78
I20260621 08:05:15.720463 11036 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.720610 11036 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 78 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.720815 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 78 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:15.720866 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 78 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.721061 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 78 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:15.721159 11036 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Leader election lost for term 78. Reason: could not achieve majority
I20260621 08:05:15.730870 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 77. Current term is 78. Ops: []
I20260621 08:05:15.731240 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 77.81, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260621 08:05:15.731364 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 LEADER]: Stepping down as leader of term 77
I20260621 08:05:15.731417 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:15.731484 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 77.81, Last appended by leader: 81, Current term: 77, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.731582 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 77 FOLLOWER]: Advancing to term 78
I20260621 08:05:15.821441 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 77 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:15.821555 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 77 FOLLOWER]: Advancing to term 78
I20260621 08:05:15.822261 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.822481 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 78 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.822680 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 78 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:15.822693 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 78 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.822769 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 78: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:15.823366 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 78.
I20260621 08:05:15.823535 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:15.823619 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 FOLLOWER]: Leader election won for term 78
I20260621 08:05:15.823673 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.823719 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 77.81, Last appended by leader: 81, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.824143 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 77 to 78, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 78 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:15.845093 11036 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:15.845177 11036 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 78 FOLLOWER]: Advancing to term 79
I20260621 08:05:15.845818 11036 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.845963 11036 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 79 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:15.846194 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 79 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:15.846273 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 78 FOLLOWER]: Advancing to term 79
I20260621 08:05:15.846216 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 79 candidate_status { last_received { term: 77 index: 81 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:15.847083 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 79 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 79.
I20260621 08:05:15.847296 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 79 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:15.847383 11036 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 FOLLOWER]: Leader election won for term 79
I20260621 08:05:15.847437 11036 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:15.847476 11036 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 77.81, Last appended by leader: 81, Current term: 79, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.847935 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 78 to 79, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 79 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:15.906620 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 78. Current term is 79. Ops: []
I20260621 08:05:15.906911 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260621 08:05:15.907055 11023 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 79.82 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 81
I20260621 08:05:15.907109 11035 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 LEADER]: Stepping down as leader of term 78
I20260621 08:05:15.907171 11035 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:15.907258 11035 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 78.82, Last appended by leader: 82, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:15.907337 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 78 FOLLOWER]: Advancing to term 79
I20260621 08:05:15.937532 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 79 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 78 index: 82. Preceding OpId from leader: term: 79 index: 82. (term mismatch)
I20260621 08:05:15.937605 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 81
I20260621 08:05:15.937618 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 78.82
I20260621 08:05:15.937633 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 79 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:15.937814 11036 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260621 08:05:15.938802 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 79 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 77 index: 81. Preceding OpId from leader: term: 79 index: 82. (index mismatch)
I20260621 08:05:15.939062 11036 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260621 08:05:16.040436 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 79 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:16.040552 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 79 FOLLOWER]: Advancing to term 80
I20260621 08:05:16.041298 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.041522 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 80 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:16.041735 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 80 candidate_status { last_received { term: 79 index: 82 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:16.041813 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 79 FOLLOWER]: Advancing to term 80
I20260621 08:05:16.041742 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 80 candidate_status { last_received { term: 79 index: 82 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:16.042408 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 80.
I20260621 08:05:16.042627 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:16.042719 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 FOLLOWER]: Leader election won for term 80
I20260621 08:05:16.042789 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:16.042840 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 79.82, Last appended by leader: 82, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.043311 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 79 to 80, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 80 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:16.049525 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 80 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 79. Current term is 80. Ops: []
I20260621 08:05:16.049747 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 79.82, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260621 08:05:16.049829 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 LEADER]: Stepping down as leader of term 79
I20260621 08:05:16.049860 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:16.049911 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 79.82, Last appended by leader: 82, Current term: 79, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.049986 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 79 FOLLOWER]: Advancing to term 80
I20260621 08:05:16.151708 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 80 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 79 index: 82. Preceding OpId from leader: term: 80 index: 83. (index mismatch)
I20260621 08:05:16.151991 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260621 08:05:16.153098 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 80 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 79 index: 82. Preceding OpId from leader: term: 80 index: 83. (index mismatch)
I20260621 08:05:16.153293 11039 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260621 08:05:16.367522 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 80 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:16.367619 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 80 FOLLOWER]: Advancing to term 81
I20260621 08:05:16.368247 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.368402 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 81 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:16.368643 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 81 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:16.368647 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 81 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:16.368872 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 81 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:16.368952 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Leader election lost for term 81. Reason: could not achieve majority
I20260621 08:05:16.376085 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 80. Current term is 81. Ops: []
I20260621 08:05:16.376334 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 80.83, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260621 08:05:16.376466 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 LEADER]: Stepping down as leader of term 80
I20260621 08:05:16.376502 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:16.376545 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 80.83, Last appended by leader: 83, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.376602 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 80 FOLLOWER]: Advancing to term 81
I20260621 08:05:16.428535 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 80 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:16.428638 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 80 FOLLOWER]: Advancing to term 81
I20260621 08:05:16.429255 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.429410 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 81 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:16.429611 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 81 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:16.429611 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 81 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:16.429740 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 81: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:16.430229 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 81 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 81.
I20260621 08:05:16.430398 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 81 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:16.430486 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 FOLLOWER]: Leader election won for term 81
I20260621 08:05:16.430553 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:16.430603 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 80.83, Last appended by leader: 83, Current term: 81, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.431049 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 80 to 81, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 81 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:16.468865 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:16.494359 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:16.494472 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 81 FOLLOWER]: Advancing to term 82
I20260621 08:05:16.496021 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.496196 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 82 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:16.496398 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 82 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:16.496443 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 82 candidate_status { last_received { term: 80 index: 83 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:16.496539 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 81 FOLLOWER]: Advancing to term 82
I20260621 08:05:16.497074 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 82.
I20260621 08:05:16.497253 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:16.497341 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 FOLLOWER]: Leader election won for term 82
I20260621 08:05:16.497392 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:16.497443 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 80.83, Last appended by leader: 83, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.497869 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 81 to 82, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 82 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:16.508420 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 82 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 81. Current term is 82. Ops: []
I20260621 08:05:16.508680 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260621 08:05:16.508797 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 LEADER]: Stepping down as leader of term 81
I20260621 08:05:16.508831 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:16.508890 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 81.84, Last appended by leader: 84, Current term: 81, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.508955 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 81 FOLLOWER]: Advancing to term 82
I20260621 08:05:16.592363 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 82 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 81 index: 84. Preceding OpId from leader: term: 82 index: 84. (term mismatch)
I20260621 08:05:16.592443 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 83
I20260621 08:05:16.592458 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 81.84
I20260621 08:05:16.592471 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 82 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:16.592657 11021 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260621 08:05:16.593683 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 82 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 80 index: 83. Preceding OpId from leader: term: 82 index: 84. (index mismatch)
I20260621 08:05:16.593977 11040 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260621 08:05:16.695385 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 82 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:16.695484 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 82 FOLLOWER]: Advancing to term 83
I20260621 08:05:16.696171 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.696329 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 83 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:16.696569 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 83 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:16.696578 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 83 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:16.696818 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 83 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:16.696938 11038 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Leader election lost for term 83. Reason: could not achieve majority
I20260621 08:05:16.715665 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 82. Current term is 83. Ops: []
I20260621 08:05:16.715911 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 82.84, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260621 08:05:16.716025 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 LEADER]: Stepping down as leader of term 82
I20260621 08:05:16.716058 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:16.716115 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 82.84, Last appended by leader: 84, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.716188 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 82 FOLLOWER]: Advancing to term 83
I20260621 08:05:16.773233 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 82 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:16.773327 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 82 FOLLOWER]: Advancing to term 83
I20260621 08:05:16.773947 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.774114 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 83 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:16.774322 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 83 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:16.774322 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 83 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:16.774421 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 83: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:16.775086 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 83 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 83.
I20260621 08:05:16.775303 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 83 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:16.775439 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 FOLLOWER]: Leader election won for term 83
I20260621 08:05:16.775496 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:16.775548 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 82.84, Last appended by leader: 84, Current term: 83, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.775985 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 82 to 83, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 83 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:16.845758 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:16.845846 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 83 FOLLOWER]: Advancing to term 84
I20260621 08:05:16.846516 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.846674 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 84 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:16.846895 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 84 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:16.846936 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 84 candidate_status { last_received { term: 82 index: 84 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:16.846973 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 83 FOLLOWER]: Advancing to term 84
I20260621 08:05:16.847571 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 84.
I20260621 08:05:16.847745 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:16.847831 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 FOLLOWER]: Leader election won for term 84
I20260621 08:05:16.847879 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:16.847923 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 82.84, Last appended by leader: 84, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.848331 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 83 to 84, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 84 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:16.862557 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 84 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 83. Current term is 84. Ops: []
I20260621 08:05:16.862804 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260621 08:05:16.862891 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 LEADER]: Stepping down as leader of term 83
I20260621 08:05:16.862907 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:16.862953 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 83.85, Last appended by leader: 85, Current term: 83, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:16.863035 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 83 FOLLOWER]: Advancing to term 84
I20260621 08:05:16.930931 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 84 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 82 index: 84. Preceding OpId from leader: term: 84 index: 85. (index mismatch)
I20260621 08:05:16.931286 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260621 08:05:16.932263 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 84 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 83 index: 85. Preceding OpId from leader: term: 84 index: 85. (term mismatch)
I20260621 08:05:16.932323 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 84
I20260621 08:05:16.932343 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 83.85
I20260621 08:05:16.932358 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 84 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:16.932502 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260621 08:05:17.196187 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 84 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:17.196290 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 84 FOLLOWER]: Advancing to term 85
I20260621 08:05:17.196918 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.197070 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 85 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:17.197324 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 85 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:17.197369 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 85 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:17.197588 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 85 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:17.197676 11021 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Leader election lost for term 85. Reason: could not achieve majority
I20260621 08:05:17.208209 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 84. Current term is 85. Ops: []
I20260621 08:05:17.208441 11022 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 84.85, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260621 08:05:17.208562 11022 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 LEADER]: Stepping down as leader of term 84
I20260621 08:05:17.208598 11022 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:17.208657 11022 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 84.85, Last appended by leader: 85, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.208732 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 84 FOLLOWER]: Advancing to term 85
I20260621 08:05:17.270865 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 84 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:17.270962 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 84 FOLLOWER]: Advancing to term 85
I20260621 08:05:17.271659 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.271809 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 85 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:17.272001 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 85 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:17.272003 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 85 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:17.272135 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 85: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:17.272570 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 85 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 85.
I20260621 08:05:17.272720 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 85 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:17.272807 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 FOLLOWER]: Leader election won for term 85
I20260621 08:05:17.272861 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:17.272910 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 84.85, Last appended by leader: 85, Current term: 85, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.273326 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 84 to 85, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 85 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:17.317581 11021 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:17.317677 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 85 FOLLOWER]: Advancing to term 86
I20260621 08:05:17.318308 11021 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.318450 11021 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 86 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:17.318677 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 86 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:17.318677 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 86 candidate_status { last_received { term: 84 index: 85 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:17.318806 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 85 FOLLOWER]: Advancing to term 86
I20260621 08:05:17.319366 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 86.
I20260621 08:05:17.319515 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:17.319613 11021 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 FOLLOWER]: Leader election won for term 86
I20260621 08:05:17.319710 11021 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:17.319752 11021 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 84.85, Last appended by leader: 85, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.320201 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 85 to 86, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 86 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:17.375651 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 86 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 85. Current term is 86. Ops: []
I20260621 08:05:17.375908 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260621 08:05:17.376021 11023 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 LEADER]: Stepping down as leader of term 85
I20260621 08:05:17.376050 11023 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:17.376098 11023 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 85.86, Last appended by leader: 86, Current term: 85, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.376163 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 85 FOLLOWER]: Advancing to term 86
I20260621 08:05:17.405686 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 86 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 84 index: 85. Preceding OpId from leader: term: 86 index: 86. (index mismatch)
I20260621 08:05:17.405946 11021 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260621 08:05:17.406890 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 86 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 85 index: 86. Preceding OpId from leader: term: 86 index: 86. (term mismatch)
I20260621 08:05:17.406942 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 85
I20260621 08:05:17.406960 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 85.86
I20260621 08:05:17.406977 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 86 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:17.407131 11042 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260621 08:05:17.469108 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:17.506978 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 86 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:17.507069 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 86 FOLLOWER]: Advancing to term 87
I20260621 08:05:17.507742 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.507938 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 87 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:17.507930 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 86. Current term is 87. Ops: []
I20260621 08:05:17.508090 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 87 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:17.508126 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 87 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:17.508312 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 87 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:17.508318 11043 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 86.86, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260621 08:05:17.508447 11043 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 LEADER]: Stepping down as leader of term 86
I20260621 08:05:17.508455 11022 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Leader election lost for term 87. Reason: could not achieve majority
I20260621 08:05:17.508486 11043 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:17.508580 11043 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 86.86, Last appended by leader: 86, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.508664 11043 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 86 FOLLOWER]: Advancing to term 87
I20260621 08:05:17.601745 11023 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 86 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:17.601846 11023 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 86 FOLLOWER]: Advancing to term 87
I20260621 08:05:17.602473 11023 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.602622 11023 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 87 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:17.602829 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 87 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:17.602911 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 87: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:17.602836 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 87 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:17.603583 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 87 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 87.
I20260621 08:05:17.603754 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 87 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:17.603838 11023 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 FOLLOWER]: Leader election won for term 87
I20260621 08:05:17.603889 11023 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:17.603940 11023 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 86.86, Last appended by leader: 86, Current term: 87, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.604405 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 86 to 87, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 87 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:17.644950 11022 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:17.645048 11022 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 87 FOLLOWER]: Advancing to term 88
I20260621 08:05:17.645681 11022 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.645834 11022 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 88 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:17.646076 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 88 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:17.646083 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 88 candidate_status { last_received { term: 86 index: 86 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:17.646207 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 87 FOLLOWER]: Advancing to term 88
I20260621 08:05:17.646763 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 88.
I20260621 08:05:17.646937 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:17.647029 11022 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 FOLLOWER]: Leader election won for term 88
I20260621 08:05:17.647086 11022 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:17.647142 11022 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 86.86, Last appended by leader: 86, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.647670 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 87 to 88, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 88 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:17.679656 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 87. Current term is 88. Ops: []
I20260621 08:05:17.679937 11023 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260621 08:05:17.680064 11023 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 88.87 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 86
I20260621 08:05:17.680099 11035 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 LEADER]: Stepping down as leader of term 87
I20260621 08:05:17.680138 11035 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:17.680192 11035 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 87.87, Last appended by leader: 87, Current term: 87, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.680275 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 87 FOLLOWER]: Advancing to term 88
I20260621 08:05:17.730119 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 88 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 87 index: 87. Preceding OpId from leader: term: 88 index: 87. (term mismatch)
I20260621 08:05:17.730198 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 86
I20260621 08:05:17.730216 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 87.87
I20260621 08:05:17.730234 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 88 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:17.730461 11022 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260621 08:05:17.731628 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 88 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 86 index: 86. Preceding OpId from leader: term: 88 index: 87. (index mismatch)
I20260621 08:05:17.731801 11044 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260621 08:05:17.832260 11043 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 88 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:17.832373 11043 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 88 FOLLOWER]: Advancing to term 89
I20260621 08:05:17.833151 11043 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.833335 11043 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 89 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:17.833562 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 89 candidate_status { last_received { term: 88 index: 87 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:17.833568 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 89 candidate_status { last_received { term: 88 index: 87 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:17.833666 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 88 FOLLOWER]: Advancing to term 89
I20260621 08:05:17.834229 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 89.
I20260621 08:05:17.834398 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:17.834488 11043 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 FOLLOWER]: Leader election won for term 89
I20260621 08:05:17.834558 11043 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:17.834618 11043 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 88.87, Last appended by leader: 87, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.835116 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 88 to 89, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 89 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:17.837074 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 88. Current term is 89. Ops: []
I20260621 08:05:17.837294 11044 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 88.87, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260621 08:05:17.837373 11044 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 89.88 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 87
I20260621 08:05:17.837400 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 LEADER]: Stepping down as leader of term 88
I20260621 08:05:17.837457 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:17.837535 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 88.87, Last appended by leader: 87, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:17.837613 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 88 FOLLOWER]: Advancing to term 89
I20260621 08:05:17.915570 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 89 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 88 index: 87. Preceding OpId from leader: term: 89 index: 88. (index mismatch)
I20260621 08:05:17.915850 11043 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260621 08:05:17.916896 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 89 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 88 index: 87. Preceding OpId from leader: term: 89 index: 88. (index mismatch)
I20260621 08:05:17.917115 11043 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260621 08:05:18.110790 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 89 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:18.110888 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 89 FOLLOWER]: Advancing to term 90
I20260621 08:05:18.111725 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.111949 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 90 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:18.112257 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 90 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:18.112277 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 90 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:18.115373 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 90 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:18.115490 11038 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Leader election lost for term 90. Reason: could not achieve majority
I20260621 08:05:18.121120 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 89. Current term is 90. Ops: []
I20260621 08:05:18.121398 11021 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 89.88, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260621 08:05:18.121559 11021 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 LEADER]: Stepping down as leader of term 89
I20260621 08:05:18.121593 11021 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:18.121647 11021 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 89.88, Last appended by leader: 88, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.121726 11021 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 89 FOLLOWER]: Advancing to term 90
I20260621 08:05:18.195935 11035 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 89 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:18.196046 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 89 FOLLOWER]: Advancing to term 90
I20260621 08:05:18.196805 11035 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.197001 11035 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 90 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:18.197230 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 90 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:18.197230 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 90 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:18.197372 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 90: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:18.197901 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 90.
I20260621 08:05:18.198096 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:18.198192 11035 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 FOLLOWER]: Leader election won for term 90
I20260621 08:05:18.198295 11035 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:18.198340 11035 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 89.88, Last appended by leader: 88, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.198768 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 89 to 90, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 90 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:18.262817 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:18.262913 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 90 FOLLOWER]: Advancing to term 91
I20260621 08:05:18.263587 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.263747 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 91 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:18.263979 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 91 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:18.263979 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 91 candidate_status { last_received { term: 89 index: 88 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:18.264114 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 90 FOLLOWER]: Advancing to term 91
I20260621 08:05:18.264638 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 91 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 91.
I20260621 08:05:18.264816 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 91 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:18.264906 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 FOLLOWER]: Leader election won for term 91
I20260621 08:05:18.264953 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:18.265002 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 89.88, Last appended by leader: 88, Current term: 91, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.265434 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 90 to 91, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 91 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:18.305771 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 91 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 90. Current term is 91. Ops: []
I20260621 08:05:18.306047 11035 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260621 08:05:18.306154 11035 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 LEADER]: Stepping down as leader of term 90
I20260621 08:05:18.306183 11035 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:18.306239 11035 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 90.89, Last appended by leader: 89, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.306310 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 90 FOLLOWER]: Advancing to term 91
I20260621 08:05:18.365839 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 91 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 90 index: 89. Preceding OpId from leader: term: 91 index: 89. (term mismatch)
I20260621 08:05:18.365911 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 88
I20260621 08:05:18.365924 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 90.89
I20260621 08:05:18.365938 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 91 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:18.366173 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260621 08:05:18.367158 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 91 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 89 index: 88. Preceding OpId from leader: term: 91 index: 89. (index mismatch)
I20260621 08:05:18.367381 11046 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260621 08:05:18.469326 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:18.655936 11042 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 91 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:18.656041 11042 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 91 FOLLOWER]: Advancing to term 92
I20260621 08:05:18.656752 11042 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.656886 11042 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 92 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:18.657128 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 92 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:18.657128 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 92 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:18.657397 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:18.657481 11042 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260621 08:05:18.663516 11035 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 91 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:18.663578 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 91 FOLLOWER]: Advancing to term 92
I20260621 08:05:18.664155 11035 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.664283 11035 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 92 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:18.664455 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 92 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:18.664469 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 92 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:18.664551 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 92: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:18.664743 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 92 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:18.664875 11035 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 92 FOLLOWER]: Leader election lost for term 92. Reason: could not achieve majority
I20260621 08:05:18.668865 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 91. Current term is 92. Ops: []
I20260621 08:05:18.669102 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 91.89, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260621 08:05:18.669214 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 LEADER]: Stepping down as leader of term 91
I20260621 08:05:18.669250 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:18.669314 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 91.89, Last appended by leader: 89, Current term: 91, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.669402 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 91 FOLLOWER]: Advancing to term 92
I20260621 08:05:18.784220 11035 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 92 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:18.784307 11035 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 92 FOLLOWER]: Advancing to term 93
I20260621 08:05:18.784922 11035 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.785077 11035 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 93 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:18.785198 11042 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:18.785269 11042 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 92 FOLLOWER]: Advancing to term 93
I20260621 08:05:18.785275 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 93 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:18.785276 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 93 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:18.785367 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 92 FOLLOWER]: Advancing to term 93
I20260621 08:05:18.785928 11042 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.785981 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 93.
I20260621 08:05:18.786037 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 93: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:18.786049 11042 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 93 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:18.786193 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 93 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:18.786207 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 93 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:18.786302 11035 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 FOLLOWER]: Leader election won for term 93
I20260621 08:05:18.786362 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 93 candidate_status { last_received { term: 91 index: 89 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:18.786405 11035 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:18.786306 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 93 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 93: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:18.786468 11035 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 91.89, Last appended by leader: 89, Current term: 93, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:18.786726 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 93 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:18.786818 11042 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Leader election lost for term 93. Reason: could not achieve majority
I20260621 08:05:18.786875 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 91 to 93, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 93 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:18.873346 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 93 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 91 index: 89. Preceding OpId from leader: term: 93 index: 90. (index mismatch)
I20260621 08:05:18.873638 11035 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260621 08:05:18.874550 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 91 index: 89. Preceding OpId from leader: term: 93 index: 90. (index mismatch)
I20260621 08:05:18.874712 11035 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260621 08:05:19.074410 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 93 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:19.074512 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 93 FOLLOWER]: Advancing to term 94
I20260621 08:05:19.075168 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.075367 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 94 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:19.075564 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 94 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:19.075593 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 94 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:19.075824 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 94 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:19.075907 11038 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Leader election lost for term 94. Reason: could not achieve majority
I20260621 08:05:19.097229 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 93. Current term is 94. Ops: []
I20260621 08:05:19.097589 11051 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 93.90, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260621 08:05:19.097734 11051 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 LEADER]: Stepping down as leader of term 93
I20260621 08:05:19.097770 11051 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:19.097829 11051 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 93.90, Last appended by leader: 90, Current term: 93, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.097908 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 93 FOLLOWER]: Advancing to term 94
I20260621 08:05:19.158910 11050 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:19.159018 11050 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 93 FOLLOWER]: Advancing to term 94
I20260621 08:05:19.159806 11050 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.160000 11050 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 94 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:19.160209 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 94 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:19.160209 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 94 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:19.160341 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 94: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:19.160962 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 94.
I20260621 08:05:19.161135 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 94 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:19.161214 11050 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 FOLLOWER]: Leader election won for term 94
I20260621 08:05:19.161278 11050 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:19.161329 11050 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 93.90, Last appended by leader: 90, Current term: 94, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.161751 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 93 to 94, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 94 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:19.204751 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:19.204885 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 94 FOLLOWER]: Advancing to term 95
I20260621 08:05:19.205598 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.205760 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 95 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:19.205971 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 95 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:19.205986 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 95 candidate_status { last_received { term: 93 index: 90 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:19.206106 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 94 FOLLOWER]: Advancing to term 95
I20260621 08:05:19.206670 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 95.
I20260621 08:05:19.206939 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:19.207077 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 FOLLOWER]: Leader election won for term 95
I20260621 08:05:19.207254 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:19.207311 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 93.90, Last appended by leader: 90, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.207798 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 94 to 95, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 95 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:19.242190 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 95 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 94. Current term is 95. Ops: []
I20260621 08:05:19.242475 11050 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260621 08:05:19.242604 11050 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 LEADER]: Stepping down as leader of term 94
I20260621 08:05:19.242623 11050 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:19.242686 11050 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 94.91, Last appended by leader: 91, Current term: 94, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.242758 11050 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 94 FOLLOWER]: Advancing to term 95
I20260621 08:05:19.291144 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 95 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 93 index: 90. Preceding OpId from leader: term: 95 index: 91. (index mismatch)
I20260621 08:05:19.291468 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260621 08:05:19.292567 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 95 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 94 index: 91. Preceding OpId from leader: term: 95 index: 91. (term mismatch)
I20260621 08:05:19.292620 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 90
I20260621 08:05:19.292639 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 94.91
I20260621 08:05:19.292654 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 95 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:19.292807 11052 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260621 08:05:19.469540 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:19.494360 11042 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 95 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:19.494459 11042 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 95 FOLLOWER]: Advancing to term 96
I20260621 08:05:19.495160 11042 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.495348 11042 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 96 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:19.495568 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 96 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:19.495587 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 96 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:19.495827 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 96 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:19.495872 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 95. Current term is 96. Ops: []
I20260621 08:05:19.495957 11042 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Leader election lost for term 96. Reason: could not achieve majority
I20260621 08:05:19.496121 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 95.91, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260621 08:05:19.496220 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 LEADER]: Stepping down as leader of term 95
I20260621 08:05:19.496240 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:19.496292 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 95.91, Last appended by leader: 91, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.496361 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 95 FOLLOWER]: Advancing to term 96
I20260621 08:05:19.583057 11051 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 95 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:19.583160 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 95 FOLLOWER]: Advancing to term 96
I20260621 08:05:19.583905 11051 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.584067 11051 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 96 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:19.584277 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 96 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:19.584281 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 96 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:19.584389 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 96: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:19.584896 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 96 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 96.
I20260621 08:05:19.585052 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 96 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:19.585170 11051 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 FOLLOWER]: Leader election won for term 96
I20260621 08:05:19.585242 11051 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:19.585299 11051 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 95.91, Last appended by leader: 91, Current term: 96, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.585716 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 95 to 96, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 96 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:19.607741 11042 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:19.607842 11042 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 96 FOLLOWER]: Advancing to term 97
I20260621 08:05:19.608536 11042 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.608695 11042 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 97 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:19.608968 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 97 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:19.608999 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 97 candidate_status { last_received { term: 95 index: 91 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:19.609066 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 96 FOLLOWER]: Advancing to term 97
I20260621 08:05:19.609649 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 97 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 97.
I20260621 08:05:19.609848 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 97 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:19.609953 11042 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 FOLLOWER]: Leader election won for term 97
I20260621 08:05:19.610030 11042 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:19.610091 11042 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 95.91, Last appended by leader: 91, Current term: 97, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.610630 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 96 to 97, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 97 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:19.691150 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 96. Current term is 97. Ops: []
I20260621 08:05:19.691450 11051 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260621 08:05:19.691584 11051 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 97.92 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 91
I20260621 08:05:19.691620 11045 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 LEADER]: Stepping down as leader of term 96
I20260621 08:05:19.691663 11045 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:19.691717 11045 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 96.92, Last appended by leader: 92, Current term: 96, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:19.691802 11045 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 96 FOLLOWER]: Advancing to term 97
I20260621 08:05:19.693861 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 97 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 95 index: 91. Preceding OpId from leader: term: 97 index: 92. (index mismatch)
I20260621 08:05:19.694114 11042 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260621 08:05:19.695104 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 97 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 96 index: 92. Preceding OpId from leader: term: 97 index: 92. (term mismatch)
I20260621 08:05:19.695152 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 91
I20260621 08:05:19.695169 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 96.92
I20260621 08:05:19.695185 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 97 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:19.695335 11042 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260621 08:05:20.065907 11051 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 97 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:20.066010 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 97 FOLLOWER]: Advancing to term 98
I20260621 08:05:20.066695 11051 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.066864 11051 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 98 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:20.067118 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 98 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:20.067114 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 98 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:20.067425 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 98 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:20.067528 11051 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Leader election lost for term 98. Reason: could not achieve majority
I20260621 08:05:20.081903 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 97. Current term is 98. Ops: []
I20260621 08:05:20.082232 11053 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 97.92, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260621 08:05:20.082383 11053 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 LEADER]: Stepping down as leader of term 97
I20260621 08:05:20.082419 11053 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:20.082494 11053 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 97.92, Last appended by leader: 92, Current term: 97, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.082581 11053 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 97 FOLLOWER]: Advancing to term 98
I20260621 08:05:20.135537 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 97 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:20.135660 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 97 FOLLOWER]: Advancing to term 98
I20260621 08:05:20.136296 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.136456 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 98 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:20.136662 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 98 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:20.136667 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 98 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:20.136762 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 98: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:20.137302 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 98.
I20260621 08:05:20.137532 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:20.137627 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 FOLLOWER]: Leader election won for term 98
I20260621 08:05:20.137727 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:20.137779 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 97.92, Last appended by leader: 92, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.138248 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 97 to 98, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 98 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:20.182068 11051 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:20.182168 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 98 FOLLOWER]: Advancing to term 99
I20260621 08:05:20.182911 11051 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.183075 11051 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 99 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:20.183301 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 99 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:20.183306 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 99 candidate_status { last_received { term: 97 index: 92 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:20.183410 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 98 FOLLOWER]: Advancing to term 99
I20260621 08:05:20.183975 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 99.
I20260621 08:05:20.184134 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 99 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:20.184221 11051 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 FOLLOWER]: Leader election won for term 99
I20260621 08:05:20.184273 11051 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:20.184325 11051 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 97.92, Last appended by leader: 92, Current term: 99, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.184716 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 98 to 99, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 99 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:20.242049 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 98. Current term is 99. Ops: []
I20260621 08:05:20.242340 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260621 08:05:20.242447 11038 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 99.93 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 92
I20260621 08:05:20.242487 11054 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 LEADER]: Stepping down as leader of term 98
I20260621 08:05:20.242533 11054 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:20.242605 11054 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 98.93, Last appended by leader: 93, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.242697 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 98 FOLLOWER]: Advancing to term 99
I20260621 08:05:20.282935 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 99 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 98 index: 93. Preceding OpId from leader: term: 99 index: 93. (term mismatch)
I20260621 08:05:20.283027 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 92
I20260621 08:05:20.283047 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 98.93
I20260621 08:05:20.283066 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 99 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:20.283119 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 99 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 97 index: 92. Preceding OpId from leader: term: 99 index: 93. (index mismatch)
I20260621 08:05:20.283281 11051 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260621 08:05:20.283370 11045 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260621 08:05:20.469792 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:20.472936 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 99 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:20.473027 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 99 FOLLOWER]: Advancing to term 100
I20260621 08:05:20.473778 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.473942 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 100 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:20.474154 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 100 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:20.474129 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 100 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:20.474375 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 100 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:20.474471 11054 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Leader election lost for term 100. Reason: could not achieve majority
I20260621 08:05:20.474684 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 99. Current term is 100. Ops: []
I20260621 08:05:20.474876 11051 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 99.93, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260621 08:05:20.474973 11051 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 LEADER]: Stepping down as leader of term 99
I20260621 08:05:20.474992 11051 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:20.475045 11051 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 99.93, Last appended by leader: 93, Current term: 99, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.475144 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 99 FOLLOWER]: Advancing to term 100
I20260621 08:05:20.553961 11053 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 99 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:20.554080 11053 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 99 FOLLOWER]: Advancing to term 100
I20260621 08:05:20.554792 11053 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.554947 11053 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 100 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:20.555166 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 100 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:20.555189 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 100 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:20.555323 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 100: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:20.555877 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 100.
I20260621 08:05:20.556041 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:20.556136 11053 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 FOLLOWER]: Leader election won for term 100
I20260621 08:05:20.556195 11053 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:20.556237 11053 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 99.93, Last appended by leader: 93, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.556694 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 99 to 100, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 100 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:20.584811 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:20.584908 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 100 FOLLOWER]: Advancing to term 101
I20260621 08:05:20.585603 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.585775 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 101 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:20.585966 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 101 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:20.586035 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 100 FOLLOWER]: Advancing to term 101
I20260621 08:05:20.585973 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 101 candidate_status { last_received { term: 99 index: 93 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:20.586689 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 101.
I20260621 08:05:20.586846 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:20.586937 11054 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 FOLLOWER]: Leader election won for term 101
I20260621 08:05:20.586989 11054 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:20.587031 11054 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 99.93, Last appended by leader: 93, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.587519 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 100 to 101, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 101 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:20.654836 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 100. Current term is 101. Ops: []
I20260621 08:05:20.655118 11053 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260621 08:05:20.655251 11053 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 101.94 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 93
I20260621 08:05:20.655292 11050 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 LEADER]: Stepping down as leader of term 100
I20260621 08:05:20.655330 11050 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:20.655390 11050 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 100.94, Last appended by leader: 94, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:20.655454 11050 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 100 FOLLOWER]: Advancing to term 101
I20260621 08:05:20.684021 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 101 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 99 index: 93. Preceding OpId from leader: term: 101 index: 94. (index mismatch)
I20260621 08:05:20.684311 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260621 08:05:20.685271 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 101 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 100 index: 94. Preceding OpId from leader: term: 101 index: 94. (term mismatch)
I20260621 08:05:20.685334 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 93
I20260621 08:05:20.685353 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 100.94
I20260621 08:05:20.685370 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 101 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:20.685516 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260621 08:05:21.057289 11053 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 101 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:21.057397 11053 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 101 FOLLOWER]: Advancing to term 102
I20260621 08:05:21.058296 11053 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.058467 11053 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 102 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:21.058712 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 102 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:21.058743 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 102 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:21.059011 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 102 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:21.059092 11053 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Leader election lost for term 102. Reason: could not achieve majority
I20260621 08:05:21.080629 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 101. Current term is 102. Ops: []
I20260621 08:05:21.080891 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 101.94, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260621 08:05:21.081012 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 LEADER]: Stepping down as leader of term 101
I20260621 08:05:21.081041 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:21.081096 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 101.94, Last appended by leader: 94, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.081174 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 101 FOLLOWER]: Advancing to term 102
I20260621 08:05:21.145706 11051 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 101 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:21.145808 11051 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 101 FOLLOWER]: Advancing to term 102
I20260621 08:05:21.146478 11051 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.146670 11051 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 102 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:21.146878 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 102 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:21.146896 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 102 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:21.147007 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 102: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:21.147565 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 102 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 102.
I20260621 08:05:21.147750 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 102 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:21.147828 11051 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 FOLLOWER]: Leader election won for term 102
I20260621 08:05:21.147927 11051 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:21.147967 11051 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 101.94, Last appended by leader: 94, Current term: 102, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.148412 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 101 to 102, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 102 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:21.189345 11053 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:21.189445 11053 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 102 FOLLOWER]: Advancing to term 103
I20260621 08:05:21.190160 11053 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.190325 11053 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 103 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:21.190551 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 103 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:21.190534 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 103 candidate_status { last_received { term: 101 index: 94 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:21.190623 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 102 FOLLOWER]: Advancing to term 103
I20260621 08:05:21.191172 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 103 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 103.
I20260621 08:05:21.191356 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 103 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:21.191457 11053 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 FOLLOWER]: Leader election won for term 103
I20260621 08:05:21.191560 11053 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:21.191612 11053 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 101.94, Last appended by leader: 94, Current term: 103, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.192054 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 102 to 103, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 103 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:21.240957 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 102. Current term is 103. Ops: []
I20260621 08:05:21.241282 11051 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260621 08:05:21.241392 11051 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 103.95 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 94
I20260621 08:05:21.241436 11059 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 LEADER]: Stepping down as leader of term 102
I20260621 08:05:21.241483 11059 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:21.241554 11059 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 102.95, Last appended by leader: 95, Current term: 102, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.241643 11059 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 102 FOLLOWER]: Advancing to term 103
I20260621 08:05:21.274060 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 103 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 102 index: 95. Preceding OpId from leader: term: 103 index: 95. (term mismatch)
I20260621 08:05:21.274147 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 94
I20260621 08:05:21.274160 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 102.95
I20260621 08:05:21.274174 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 103 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:21.274380 11053 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260621 08:05:21.275316 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 103 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 101 index: 94. Preceding OpId from leader: term: 103 index: 95. (index mismatch)
I20260621 08:05:21.275573 11053 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260621 08:05:21.462809 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 103 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:21.462909 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 103 FOLLOWER]: Advancing to term 104
I20260621 08:05:21.463644 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.463809 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 104 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:21.464016 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 104 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:21.464016 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 104 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:21.464269 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 104 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:21.464363 11054 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 104 FOLLOWER]: Leader election lost for term 104. Reason: could not achieve majority
I20260621 08:05:21.470037 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:21.470176 11059 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 103 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:21.470245 11059 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 103 FOLLOWER]: Advancing to term 104
I20260621 08:05:21.470891 11059 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.471065 11059 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 104 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:21.471283 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 104 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:21.471287 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 104 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:21.471390 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 104 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 104: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:21.471588 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 104 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:21.471700 11059 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 104 FOLLOWER]: Leader election lost for term 104. Reason: could not achieve majority
I20260621 08:05:21.473165 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 104 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 103. Current term is 104. Ops: []
I20260621 08:05:21.473351 11064 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 103.95, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260621 08:05:21.473464 11064 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 LEADER]: Stepping down as leader of term 103
I20260621 08:05:21.473490 11064 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:21.473554 11064 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 103.95, Last appended by leader: 95, Current term: 103, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.473635 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 103 FOLLOWER]: Advancing to term 104
I20260621 08:05:21.583727 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 104 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:21.583823 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 104 FOLLOWER]: Advancing to term 105
I20260621 08:05:21.585163 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.585330 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 105 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:21.585546 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 105 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:21.585551 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 105 candidate_status { last_received { term: 103 index: 95 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:21.585629 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 104 FOLLOWER]: Advancing to term 105
I20260621 08:05:21.585673 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 104 FOLLOWER]: Advancing to term 105
I20260621 08:05:21.586226 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 105.
I20260621 08:05:21.586301 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 105.
I20260621 08:05:21.586416 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 105 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters:
I20260621 08:05:21.586505 11054 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 FOLLOWER]: Leader election won for term 105
I20260621 08:05:21.586575 11054 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:21.586625 11054 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 103.95, Last appended by leader: 95, Current term: 105, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.587046 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 103 to 105, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 105 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:21.669426 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 105 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 103 index: 95. Preceding OpId from leader: term: 105 index: 96. (index mismatch)
I20260621 08:05:21.669715 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260621 08:05:21.670763 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 105 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 103 index: 95. Preceding OpId from leader: term: 105 index: 96. (index mismatch)
I20260621 08:05:21.670958 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260621 08:05:21.771852 11064 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 105 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:21.771947 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 105 FOLLOWER]: Advancing to term 106
I20260621 08:05:21.772624 11064 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.772780 11064 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 106 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:21.773034 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 106 candidate_status { last_received { term: 105 index: 96 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:21.773102 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 105 FOLLOWER]: Advancing to term 106
I20260621 08:05:21.773047 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 106 candidate_status { last_received { term: 105 index: 96 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:21.773603 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 106 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 106.
I20260621 08:05:21.773787 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 106 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:21.773866 11064 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 FOLLOWER]: Leader election won for term 106
I20260621 08:05:21.773916 11064 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:21.773968 11064 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 105.96, Last appended by leader: 96, Current term: 106, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.774418 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 105 to 106, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 106 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:21.789330 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 105. Current term is 106. Ops: []
I20260621 08:05:21.789597 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 105.96, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260621 08:05:21.789713 11038 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 106.97 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 96
I20260621 08:05:21.789746 11054 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 LEADER]: Stepping down as leader of term 105
I20260621 08:05:21.789796 11054 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:21.789855 11054 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 105.96, Last appended by leader: 96, Current term: 105, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:21.789939 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 105 FOLLOWER]: Advancing to term 106
I20260621 08:05:21.866910 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 106 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 105 index: 96. Preceding OpId from leader: term: 106 index: 97. (index mismatch)
I20260621 08:05:21.867259 11064 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260621 08:05:21.868294 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 106 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 105 index: 96. Preceding OpId from leader: term: 106 index: 97. (index mismatch)
I20260621 08:05:21.868541 11066 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260621 08:05:22.067097 11059 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 106 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:22.067202 11059 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 106 FOLLOWER]: Advancing to term 107
I20260621 08:05:22.067922 11059 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.068087 11059 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 107 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:22.068315 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 107 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:22.068312 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 107 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:22.068554 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:22.068686 11059 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260621 08:05:22.089587 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 106. Current term is 107. Ops: []
I20260621 08:05:22.089866 11066 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 106.97, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260621 08:05:22.089996 11066 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 LEADER]: Stepping down as leader of term 106
I20260621 08:05:22.090034 11066 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:22.090090 11066 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 106.97, Last appended by leader: 97, Current term: 106, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.090173 11066 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 106 FOLLOWER]: Advancing to term 107
I20260621 08:05:22.143154 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 106 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:22.143273 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 106 FOLLOWER]: Advancing to term 107
I20260621 08:05:22.144026 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.144186 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 107 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:22.144402 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 107 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:22.144480 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 107: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:22.144405 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 107 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:22.145009 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 107 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 107.
I20260621 08:05:22.145182 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 107 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:22.145262 11054 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 FOLLOWER]: Leader election won for term 107
I20260621 08:05:22.145313 11054 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:22.145367 11054 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 106.97, Last appended by leader: 97, Current term: 107, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.145790 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 106 to 107, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 107 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:22.198796 11059 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:22.198896 11059 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 107 FOLLOWER]: Advancing to term 108
I20260621 08:05:22.199608 11059 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.199780 11059 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 108 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:22.199996 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 108 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:22.199996 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 108 candidate_status { last_received { term: 106 index: 97 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:22.200138 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 107 FOLLOWER]: Advancing to term 108
I20260621 08:05:22.200698 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 108.
I20260621 08:05:22.200874 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:22.200996 11059 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 FOLLOWER]: Leader election won for term 108
I20260621 08:05:22.201148 11059 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:22.201200 11059 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 106.97, Last appended by leader: 97, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.201596 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 107 to 108, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 108 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:22.237104 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 107. Current term is 108. Ops: []
I20260621 08:05:22.237445 11054 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260621 08:05:22.237607 11054 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 108.98 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 97
I20260621 08:05:22.237653 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 LEADER]: Stepping down as leader of term 107
I20260621 08:05:22.237720 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:22.237783 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 107.98, Last appended by leader: 98, Current term: 107, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.237862 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 107 FOLLOWER]: Advancing to term 108
I20260621 08:05:22.302119 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 108 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 107 index: 98. Preceding OpId from leader: term: 108 index: 98. (term mismatch)
I20260621 08:05:22.302196 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 97
I20260621 08:05:22.302214 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 107.98
I20260621 08:05:22.302230 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 108 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:22.302451 11059 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260621 08:05:22.303500 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 108 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 106 index: 97. Preceding OpId from leader: term: 108 index: 98. (index mismatch)
I20260621 08:05:22.303776 11068 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260621 08:05:22.470247 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:22.500468 11064 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 108 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:22.500571 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 108 FOLLOWER]: Advancing to term 109
I20260621 08:05:22.501240 11064 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.501379 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 108. Current term is 109. Ops: []
I20260621 08:05:22.501405 11064 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 109 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:22.501560 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 109 candidate_status { last_received { term: 108 index: 98 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:22.501588 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 109 candidate_status { last_received { term: 108 index: 98 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:22.501718 11067 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 108.98, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260621 08:05:22.501785 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 109 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:22.501888 11064 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Leader election lost for term 109. Reason: could not achieve majority
I20260621 08:05:22.501891 11059 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 LEADER]: Stepping down as leader of term 108
I20260621 08:05:22.501945 11059 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:22.501991 11059 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 108.98, Last appended by leader: 98, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.502061 11059 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 108 FOLLOWER]: Advancing to term 109
I20260621 08:05:22.507617 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 108 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:22.507704 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 108 FOLLOWER]: Advancing to term 109
I20260621 08:05:22.508327 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.508452 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 109 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:22.508626 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 109 candidate_status { last_received { term: 108 index: 98 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:22.508632 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 109 candidate_status { last_received { term: 108 index: 98 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:22.508725 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 109: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:22.509219 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 109 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 109.
I20260621 08:05:22.509400 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 109 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:22.509493 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 FOLLOWER]: Leader election won for term 109
I20260621 08:05:22.509549 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:22.509598 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 108.98, Last appended by leader: 98, Current term: 109, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.510010 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 108 to 109, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 109 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:22.590487 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 108 index: 98. Preceding OpId from leader: term: 109 index: 99. (index mismatch)
I20260621 08:05:22.590893 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260621 08:05:22.592325 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 109 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 108 index: 98. Preceding OpId from leader: term: 109 index: 99. (index mismatch)
I20260621 08:05:22.592573 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260621 08:05:22.693065 11064 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:22.693176 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 109 FOLLOWER]: Advancing to term 110
I20260621 08:05:22.693900 11064 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.694072 11064 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 110 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:22.694334 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 110 candidate_status { last_received { term: 109 index: 99 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:22.694345 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 110 candidate_status { last_received { term: 109 index: 99 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:22.694420 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 109 FOLLOWER]: Advancing to term 110
I20260621 08:05:22.695003 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 110.
I20260621 08:05:22.695263 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 110 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:22.695391 11064 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 FOLLOWER]: Leader election won for term 110
I20260621 08:05:22.695461 11064 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:22.695506 11064 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 109.99, Last appended by leader: 99, Current term: 110, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.695945 10620 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 109 to 110, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 110 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:22.710979 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 110 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 109. Current term is 110. Ops: []
I20260621 08:05:22.711201 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 109.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260621 08:05:22.711321 11038 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 LEADER]: Stepping down as leader of term 109
I20260621 08:05:22.711351 11038 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:22.711400 11038 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 109.99, Last appended by leader: 99, Current term: 109, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.711457 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 109 FOLLOWER]: Advancing to term 110
I20260621 08:05:22.783401 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 110 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 109 index: 99. Preceding OpId from leader: term: 110 index: 100. (index mismatch)
I20260621 08:05:22.783715 11064 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260621 08:05:22.784775 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 110 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 109 index: 99. Preceding OpId from leader: term: 110 index: 100. (index mismatch)
I20260621 08:05:22.784936 11064 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260621 08:05:22.885957 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 110 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:22.886058 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 110 FOLLOWER]: Advancing to term 111
I20260621 08:05:22.886819 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.886965 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 111 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:22.887166 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 111 candidate_status { last_received { term: 110 index: 100 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:22.887172 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 111 candidate_status { last_received { term: 110 index: 100 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:22.887281 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 110 FOLLOWER]: Advancing to term 111
I20260621 08:05:22.887816 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 111 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 111.
I20260621 08:05:22.887986 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 111 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:22.888070 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 FOLLOWER]: Leader election won for term 111
I20260621 08:05:22.888123 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:22.888168 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 110.100, Last appended by leader: 100, Current term: 111, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.888589 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 110 to 111, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 111 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:22.891768 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 111 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 110. Current term is 111. Ops: []
I20260621 08:05:22.891971 11064 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 110.100, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260621 08:05:22.892055 11064 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 LEADER]: Stepping down as leader of term 110
I20260621 08:05:22.892086 11064 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:22.892156 11064 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 110.100, Last appended by leader: 100, Current term: 110, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:22.892215 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 110 FOLLOWER]: Advancing to term 111
I20260621 08:05:22.963982 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 111 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 110 index: 100. Preceding OpId from leader: term: 111 index: 101. (index mismatch)
I20260621 08:05:22.964278 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260621 08:05:22.965320 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 111 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 110 index: 100. Preceding OpId from leader: term: 111 index: 101. (index mismatch)
I20260621 08:05:22.965615 11070 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260621 08:05:23.066253 11038 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 111 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:23.066366 11038 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 111 FOLLOWER]: Advancing to term 112
I20260621 08:05:23.066987 11038 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.067155 11038 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 112 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:23.067399 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 112 candidate_status { last_received { term: 111 index: 101 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:23.067399 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 112 candidate_status { last_received { term: 111 index: 101 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:23.067484 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 111 FOLLOWER]: Advancing to term 112
I20260621 08:05:23.068005 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 112.
I20260621 08:05:23.068183 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 112 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:23.068287 11038 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 FOLLOWER]: Leader election won for term 112
I20260621 08:05:23.068354 11038 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:23.068408 11038 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 111.101, Last appended by leader: 101, Current term: 112, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.068871 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 111 to 112, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 112 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:23.082129 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 112 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 111. Current term is 112. Ops: []
I20260621 08:05:23.082355 11070 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 111.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260621 08:05:23.082444 11070 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 LEADER]: Stepping down as leader of term 111
I20260621 08:05:23.082477 11070 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:23.082540 11070 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 111.101, Last appended by leader: 101, Current term: 111, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.082623 11070 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 111 FOLLOWER]: Advancing to term 112
I20260621 08:05:23.150188 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 112 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 111 index: 101. Preceding OpId from leader: term: 112 index: 102. (index mismatch)
I20260621 08:05:23.150445 11038 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260621 08:05:23.151446 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 112 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 111 index: 101. Preceding OpId from leader: term: 112 index: 102. (index mismatch)
I20260621 08:05:23.151618 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260621 08:05:23.252130 11064 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 112 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:23.252238 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 112 FOLLOWER]: Advancing to term 113
I20260621 08:05:23.252871 11064 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.253003 11064 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 113 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:23.253202 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 113 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:23.253223 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 113 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:23.253450 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 113 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:23.253543 11064 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Leader election lost for term 113. Reason: could not achieve majority
I20260621 08:05:23.258602 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 112. Current term is 113. Ops: []
I20260621 08:05:23.258953 11038 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 112.102, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260621 08:05:23.259079 11054 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 LEADER]: Stepping down as leader of term 112
I20260621 08:05:23.259122 11054 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:23.259173 11054 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 112.102, Last appended by leader: 102, Current term: 112, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.259291 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 112 FOLLOWER]: Advancing to term 113
I20260621 08:05:23.348856 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 112 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:23.348964 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 112 FOLLOWER]: Advancing to term 113
I20260621 08:05:23.349649 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.349834 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 113 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:23.350057 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 113 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:23.350051 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 113 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:23.350186 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 113: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:23.350735 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 113.
I20260621 08:05:23.350916 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:23.351006 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 FOLLOWER]: Leader election won for term 113
I20260621 08:05:23.351056 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:23.351110 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 112.102, Last appended by leader: 102, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.351581 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 112 to 113, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 113 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:23.398981 11064 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:23.399080 11064 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 113 FOLLOWER]: Advancing to term 114
I20260621 08:05:23.399739 11064 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.399869 11064 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 114 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:23.400100 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 114 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:23.400100 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 114 candidate_status { last_received { term: 112 index: 102 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:23.400225 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 113 FOLLOWER]: Advancing to term 114
I20260621 08:05:23.400890 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 114 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 114.
I20260621 08:05:23.401103 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 114 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:23.401199 11064 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 FOLLOWER]: Leader election won for term 114
I20260621 08:05:23.401320 11064 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:23.401371 11064 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 112.102, Last appended by leader: 102, Current term: 114, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.401787 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 113 to 114, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 114 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:23.438040 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 114 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 113. Current term is 114. Ops: []
I20260621 08:05:23.438313 11067 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260621 08:05:23.438433 11067 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 LEADER]: Stepping down as leader of term 113
I20260621 08:05:23.438467 11067 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:23.438522 11067 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 113.103, Last appended by leader: 103, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.438591 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 113 FOLLOWER]: Advancing to term 114
I20260621 08:05:23.470494 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:23.481222 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 114 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 112 index: 102. Preceding OpId from leader: term: 114 index: 103. (index mismatch)
I20260621 08:05:23.481500 11064 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260621 08:05:23.482596 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 114 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 113 index: 103. Preceding OpId from leader: term: 114 index: 103. (term mismatch)
I20260621 08:05:23.482649 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 102
I20260621 08:05:23.482668 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 113.103
I20260621 08:05:23.482686 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 114 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:23.482960 11071 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260621 08:05:23.680186 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 114 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:23.680287 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 114 FOLLOWER]: Advancing to term 115
I20260621 08:05:23.680938 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.681097 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 115 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:23.681324 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 115 candidate_status { last_received { term: 114 index: 103 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:23.681329 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 115 candidate_status { last_received { term: 114 index: 103 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:23.681547 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 115 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:23.681641 11054 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Leader election lost for term 115. Reason: could not achieve majority
I20260621 08:05:23.698956 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 114. Current term is 115. Ops: []
I20260621 08:05:23.699195 11072 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 114.103, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260621 08:05:23.699321 11072 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 LEADER]: Stepping down as leader of term 114
I20260621 08:05:23.699350 11072 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:23.699414 11072 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 114.103, Last appended by leader: 103, Current term: 114, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.699497 11072 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 114 FOLLOWER]: Advancing to term 115
I20260621 08:05:23.708665 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 114 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:23.708731 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 114 FOLLOWER]: Advancing to term 115
I20260621 08:05:23.709297 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.709434 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 115 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:23.709619 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 115 candidate_status { last_received { term: 114 index: 103 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:23.709686 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 115: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:23.709646 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 115 candidate_status { last_received { term: 114 index: 103 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:23.710274 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 115 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 115.
I20260621 08:05:23.710464 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 115 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:23.710562 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 FOLLOWER]: Leader election won for term 115
I20260621 08:05:23.710620 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:23.710706 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 114.103, Last appended by leader: 103, Current term: 115, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:23.711130 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 114 to 115, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 115 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:23.795529 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 114 index: 103. Preceding OpId from leader: term: 115 index: 104. (index mismatch)
I20260621 08:05:23.795529 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 115 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 114 index: 103. Preceding OpId from leader: term: 115 index: 104. (index mismatch)
I20260621 08:05:23.795830 11070 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260621 08:05:23.795962 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260621 08:05:24.184908 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:24.184991 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 115 FOLLOWER]: Advancing to term 116
I20260621 08:05:24.185672 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.185840 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 116 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:24.185972 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 116 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:24.186028 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 116 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:24.186240 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 116 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:24.186316 11054 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Leader election lost for term 116. Reason: could not achieve majority
I20260621 08:05:24.204233 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 115. Current term is 116. Ops: []
I20260621 08:05:24.204500 11067 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 115.104, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260621 08:05:24.204625 11067 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 LEADER]: Stepping down as leader of term 115
I20260621 08:05:24.204656 11067 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:24.204716 11067 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 115.104, Last appended by leader: 104, Current term: 115, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.204787 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 115 FOLLOWER]: Advancing to term 116
I20260621 08:05:24.284005 11072 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 115 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:24.284111 11072 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 115 FOLLOWER]: Advancing to term 116
I20260621 08:05:24.284860 11072 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.285013 11072 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 116 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:24.285215 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 116 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:24.285218 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 116 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:24.285332 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 116: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:24.285933 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 116 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 116.
I20260621 08:05:24.286104 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 116 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:24.286198 11072 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 FOLLOWER]: Leader election won for term 116
I20260621 08:05:24.286321 11072 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:24.286382 11072 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 115.104, Last appended by leader: 104, Current term: 116, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.286849 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 115 to 116, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 116 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:24.300733 11054 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:24.300806 11054 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 116 FOLLOWER]: Advancing to term 117
I20260621 08:05:24.301345 11054 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.301472 11054 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 117 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:24.301638 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 117 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:24.301666 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 117 candidate_status { last_received { term: 115 index: 104 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:24.301793 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 116 FOLLOWER]: Advancing to term 117
I20260621 08:05:24.302304 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 117.
I20260621 08:05:24.302457 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 117 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:24.302543 11054 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 FOLLOWER]: Leader election won for term 117
I20260621 08:05:24.302639 11054 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:24.302713 11054 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 115.104, Last appended by leader: 104, Current term: 117, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.303097 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 116 to 117, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 117 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:24.380560 10725 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 LEADER]: Stepping down as leader of term 116
I20260621 08:05:24.380636 10725 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:24.380686 10725 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 116.105, Last appended by leader: 105, Current term: 116, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.380781 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 116 FOLLOWER]: Advancing to term 117
I20260621 08:05:24.381413 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 117 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 116 index: 105. Preceding OpId from leader: term: 117 index: 105. (term mismatch)
I20260621 08:05:24.381457 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 104
I20260621 08:05:24.381469 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 116.105
I20260621 08:05:24.381484 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 117 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:24.381687 11054 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260621 08:05:24.382676 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 117 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 115 index: 104. Preceding OpId from leader: term: 117 index: 105. (index mismatch)
I20260621 08:05:24.382929 11079 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260621 08:05:24.470717 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:24.652689 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 117 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:24.652792 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 117 FOLLOWER]: Advancing to term 118
I20260621 08:05:24.653509 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.653669 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 118 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:24.653878 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 118 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:24.653888 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 118 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:24.654134 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 118 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:24.654233 11067 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Leader election lost for term 118. Reason: could not achieve majority
I20260621 08:05:24.676096 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 117. Current term is 118. Ops: []
I20260621 08:05:24.676342 11078 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 117.105, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260621 08:05:24.676460 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 LEADER]: Stepping down as leader of term 117
I20260621 08:05:24.676481 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:24.676539 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 117.105, Last appended by leader: 105, Current term: 117, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.676621 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 117 FOLLOWER]: Advancing to term 118
I20260621 08:05:24.765702 11072 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 117 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:24.765805 11072 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 117 FOLLOWER]: Advancing to term 118
I20260621 08:05:24.766484 11072 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.766635 11072 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 118 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:24.766969 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 118 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:24.766969 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 118 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:24.767079 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 118: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:24.767714 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 118 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 118.
I20260621 08:05:24.767904 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 118 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:24.767997 11072 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 FOLLOWER]: Leader election won for term 118
I20260621 08:05:24.768056 11072 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:24.768107 11072 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 117.105, Last appended by leader: 105, Current term: 118, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.768571 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 117 to 118, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 118 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:24.794615 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:24.794728 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 118 FOLLOWER]: Advancing to term 119
I20260621 08:05:24.795512 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.795694 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 119 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:24.795888 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 119 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:24.795893 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 119 candidate_status { last_received { term: 117 index: 105 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:24.795993 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 118 FOLLOWER]: Advancing to term 119
I20260621 08:05:24.796514 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 119 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 119.
I20260621 08:05:24.796695 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 119 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:24.796792 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 FOLLOWER]: Leader election won for term 119
I20260621 08:05:24.796900 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:24.796954 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 117.105, Last appended by leader: 105, Current term: 119, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.797391 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 118 to 119, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 119 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:24.849963 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 118. Current term is 119. Ops: []
I20260621 08:05:24.850284 11072 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260621 08:05:24.850420 11072 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 119.106 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 105
I20260621 08:05:24.850458 11074 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 LEADER]: Stepping down as leader of term 118
I20260621 08:05:24.850512 11074 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:24.850639 11074 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 118.106, Last appended by leader: 106, Current term: 118, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:24.850730 11074 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 118 FOLLOWER]: Advancing to term 119
I20260621 08:05:24.873752 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 119 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 117 index: 105. Preceding OpId from leader: term: 119 index: 106. (index mismatch)
I20260621 08:05:24.874010 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260621 08:05:24.874861 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 119 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 118 index: 106. Preceding OpId from leader: term: 119 index: 106. (term mismatch)
I20260621 08:05:24.874912 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 105
I20260621 08:05:24.874931 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 118.106
I20260621 08:05:24.874948 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 119 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:24.875089 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260621 08:05:25.166253 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 119 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:25.166339 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 119 FOLLOWER]: Advancing to term 120
I20260621 08:05:25.166993 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.167146 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 120 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:25.167356 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 120 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.167364 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 120 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:25.167584 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 120 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:25.167670 11078 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Leader election lost for term 120. Reason: could not achieve majority
I20260621 08:05:25.184839 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 119. Current term is 120. Ops: []
I20260621 08:05:25.185173 11081 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 119.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260621 08:05:25.185320 11067 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 LEADER]: Stepping down as leader of term 119
I20260621 08:05:25.185365 11067 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:25.185423 11067 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 119.106, Last appended by leader: 106, Current term: 119, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.185496 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 119 FOLLOWER]: Advancing to term 120
I20260621 08:05:25.262655 11074 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 119 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:25.262760 11074 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 119 FOLLOWER]: Advancing to term 120
I20260621 08:05:25.263477 11074 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.263633 11074 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 120 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:25.263890 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 120 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.263931 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 120 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:25.264035 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 120: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:25.264494 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 120.
I20260621 08:05:25.264686 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:25.264775 11074 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 FOLLOWER]: Leader election won for term 120
I20260621 08:05:25.264832 11074 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:25.264883 11074 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 119.106, Last appended by leader: 106, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.265340 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 119 to 120, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 120 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:25.311352 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:25.311461 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 120 FOLLOWER]: Advancing to term 121
I20260621 08:05:25.312135 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.312309 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 121 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:25.312534 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 121 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:25.312536 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 121 candidate_status { last_received { term: 119 index: 106 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.312637 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 120 FOLLOWER]: Advancing to term 121
I20260621 08:05:25.313220 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 121 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 121.
I20260621 08:05:25.313385 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 121 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:25.313485 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 FOLLOWER]: Leader election won for term 121
I20260621 08:05:25.313606 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:25.313661 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 119.106, Last appended by leader: 106, Current term: 121, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.314096 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 120 to 121, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 121 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:25.341300 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 121 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 120. Current term is 121. Ops: []
I20260621 08:05:25.341653 11074 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260621 08:05:25.341787 11074 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 LEADER]: Stepping down as leader of term 120
I20260621 08:05:25.341821 11074 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:25.341883 11074 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 120.107, Last appended by leader: 107, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.341956 11074 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 120 FOLLOWER]: Advancing to term 121
I20260621 08:05:25.423594 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 121 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 120 index: 107. Preceding OpId from leader: term: 121 index: 107. (term mismatch)
I20260621 08:05:25.423679 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 106
I20260621 08:05:25.423699 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 120.107
I20260621 08:05:25.423717 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 121 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:25.423991 11078 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260621 08:05:25.424896 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 121 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 119 index: 106. Preceding OpId from leader: term: 121 index: 107. (index mismatch)
I20260621 08:05:25.425071 11082 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260621 08:05:25.470943 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:25.526348 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 121 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:25.526458 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 121 FOLLOWER]: Advancing to term 122
I20260621 08:05:25.527153 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.527401 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 122 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:25.527613 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 122 candidate_status { last_received { term: 121 index: 107 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:25.527621 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 122 candidate_status { last_received { term: 121 index: 107 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:25.527729 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 121 FOLLOWER]: Advancing to term 122
I20260621 08:05:25.528251 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 122.
I20260621 08:05:25.528438 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 122 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:25.528538 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 FOLLOWER]: Leader election won for term 122
I20260621 08:05:25.528594 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:25.528649 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 121.107, Last appended by leader: 107, Current term: 122, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.529115 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 121 to 122, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 122 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:25.531239 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 122 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 121. Current term is 122. Ops: []
I20260621 08:05:25.531445 11082 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 121.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260621 08:05:25.531569 11082 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 LEADER]: Stepping down as leader of term 121
I20260621 08:05:25.531602 11082 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:25.531662 11082 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 121.107, Last appended by leader: 107, Current term: 121, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.531744 11082 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 121 FOLLOWER]: Advancing to term 122
I20260621 08:05:25.641793 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 122 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 121 index: 107. Preceding OpId from leader: term: 122 index: 108. (index mismatch)
I20260621 08:05:25.642071 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260621 08:05:25.643018 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 122 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 121 index: 107. Preceding OpId from leader: term: 122 index: 108. (index mismatch)
I20260621 08:05:25.643186 11081 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260621 08:05:25.743876 11074 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 122 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:25.743986 11074 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 122 FOLLOWER]: Advancing to term 123
I20260621 08:05:25.744676 11074 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.744843 11074 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 123 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:25.745142 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 123 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.745150 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 123 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:25.745365 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 123 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:25.745446 11074 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Leader election lost for term 123. Reason: could not achieve majority
I20260621 08:05:25.764472 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 122. Current term is 123. Ops: []
I20260621 08:05:25.764779 11067 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 122.108, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260621 08:05:25.764887 11067 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 LEADER]: Stepping down as leader of term 122
I20260621 08:05:25.764905 11067 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:25.764950 11067 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 122.108, Last appended by leader: 108, Current term: 122, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.765009 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 122 FOLLOWER]: Advancing to term 123
I20260621 08:05:25.845781 11082 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 122 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:25.845891 11082 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 122 FOLLOWER]: Advancing to term 123
I20260621 08:05:25.846573 11082 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.846755 11082 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 123 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:25.846966 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 123 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.846964 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 123 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:25.847157 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 123: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:25.847712 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 123 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 123.
I20260621 08:05:25.847869 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 123 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:25.847954 11082 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 FOLLOWER]: Leader election won for term 123
I20260621 08:05:25.848013 11082 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:25.848069 11082 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 122.108, Last appended by leader: 108, Current term: 123, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.848484 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 122 to 123, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 123 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:25.852795 11074 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:25.852843 11074 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 123 FOLLOWER]: Advancing to term 124
I20260621 08:05:25.853356 11074 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.853467 11074 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 124 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:25.853614 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 124 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:25.853636 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 124 candidate_status { last_received { term: 122 index: 108 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:25.853665 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 123 FOLLOWER]: Advancing to term 124
I20260621 08:05:25.854192 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 124 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 124.
I20260621 08:05:25.854403 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 124 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:25.854523 11074 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 FOLLOWER]: Leader election won for term 124
I20260621 08:05:25.854722 11074 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:25.854775 11074 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 122.108, Last appended by leader: 108, Current term: 124, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.855183 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 123 to 124, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 124 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:25.932720 10877 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 LEADER]: Stepping down as leader of term 123
I20260621 08:05:25.932802 10877 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:25.932864 10877 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 123.109, Last appended by leader: 109, Current term: 123, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:25.932956 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 123 FOLLOWER]: Advancing to term 124
I20260621 08:05:25.933638 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 124 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 123 index: 109. Preceding OpId from leader: term: 124 index: 109. (term mismatch)
I20260621 08:05:25.933683 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 108
I20260621 08:05:25.933701 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 123.109
I20260621 08:05:25.933717 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 124 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:25.933946 11074 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260621 08:05:25.935031 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 124 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 122 index: 108. Preceding OpId from leader: term: 124 index: 109. (index mismatch)
I20260621 08:05:25.935232 11074 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260621 08:05:26.036669 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 124 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:26.036775 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 124 FOLLOWER]: Advancing to term 125
I20260621 08:05:26.037426 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.037588 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 125 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:26.037786 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 125 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:26.037786 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 125 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:26.038064 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 125 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:26.038156 11067 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Leader election lost for term 125. Reason: could not achieve majority
I20260621 08:05:26.040699 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 124. Current term is 125. Ops: []
I20260621 08:05:26.040871 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 124.109, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260621 08:05:26.040977 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 LEADER]: Stepping down as leader of term 124
I20260621 08:05:26.041010 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:26.041069 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 124.109, Last appended by leader: 109, Current term: 124, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.041152 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 124 FOLLOWER]: Advancing to term 125
I20260621 08:05:26.158591 11082 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 124 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:26.158694 11082 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 124 FOLLOWER]: Advancing to term 125
I20260621 08:05:26.159402 11082 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.159567 11082 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 125 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:26.159785 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 125 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:26.159791 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 125 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:26.159868 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 125: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:26.160431 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 125 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 125.
I20260621 08:05:26.160611 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 125 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:26.160701 11082 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 FOLLOWER]: Leader election won for term 125
I20260621 08:05:26.160758 11082 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:26.160804 11082 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 124.109, Last appended by leader: 109, Current term: 125, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.161228 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 124 to 125, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 125 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:26.167515 11067 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:26.167582 11067 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 125 FOLLOWER]: Advancing to term 126
I20260621 08:05:26.168143 11067 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.168267 11067 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 126 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:26.168474 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 126 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:26.168474 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 126 candidate_status { last_received { term: 124 index: 109 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:26.168576 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 125 FOLLOWER]: Advancing to term 126
I20260621 08:05:26.169103 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 126 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 126.
I20260621 08:05:26.169308 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 126 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:26.169395 11067 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 FOLLOWER]: Leader election won for term 126
I20260621 08:05:26.169445 11067 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:26.169486 11067 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 124.109, Last appended by leader: 109, Current term: 126, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.169955 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 125 to 126, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 126 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:26.249501 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 125. Current term is 126. Ops: []
I20260621 08:05:26.249796 11082 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260621 08:05:26.249905 11082 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 126.110 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 109
I20260621 08:05:26.249939 11082 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 LEADER]: Stepping down as leader of term 125
I20260621 08:05:26.249965 11082 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:26.250020 11082 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 125.110, Last appended by leader: 110, Current term: 125, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.250100 11082 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 125 FOLLOWER]: Advancing to term 126
I20260621 08:05:26.265304 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 126 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 125 index: 110. Preceding OpId from leader: term: 126 index: 110. (term mismatch)
I20260621 08:05:26.265378 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 109
I20260621 08:05:26.265393 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 125.110
I20260621 08:05:26.265405 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 126 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:26.265655 11067 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260621 08:05:26.266583 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 126 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 124 index: 109. Preceding OpId from leader: term: 126 index: 110. (index mismatch)
I20260621 08:05:26.266757 11087 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260621 08:05:26.471164 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:26.627563 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 126 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:26.627671 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 126 FOLLOWER]: Advancing to term 127
I20260621 08:05:26.629416 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.629583 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 127 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:26.629755 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 127 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:26.629772 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 126. Current term is 127. Ops: []
I20260621 08:05:26.629801 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 127 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:26.629962 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 127 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:26.629974 11087 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 126.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260621 08:05:26.630064 11085 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Leader election lost for term 127. Reason: could not achieve majority
I20260621 08:05:26.630115 11087 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 LEADER]: Stepping down as leader of term 126
I20260621 08:05:26.630151 11087 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:26.630210 11087 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 126.110, Last appended by leader: 110, Current term: 126, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.630288 11087 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 126 FOLLOWER]: Advancing to term 127
I20260621 08:05:26.637090 11082 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 126 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:26.637145 11082 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 126 FOLLOWER]: Advancing to term 127
I20260621 08:05:26.637676 11082 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.637827 11082 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 127 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:26.638012 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 127 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:26.638101 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 127: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:26.638008 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 127 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:26.638620 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 127 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 127.
I20260621 08:05:26.638803 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 127 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:26.638880 11082 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 FOLLOWER]: Leader election won for term 127
I20260621 08:05:26.638937 11082 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:26.638986 11082 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 126.110, Last appended by leader: 110, Current term: 127, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.639420 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 126 to 127, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 127 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:26.743541 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:26.743644 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 127 FOLLOWER]: Advancing to term 128
I20260621 08:05:26.744318 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.744472 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 128 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:26.744733 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 128 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:26.744738 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 128 candidate_status { last_received { term: 126 index: 110 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:26.744836 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 127 FOLLOWER]: Advancing to term 128
I20260621 08:05:26.745381 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 128.
I20260621 08:05:26.745569 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:26.745671 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 FOLLOWER]: Leader election won for term 128
I20260621 08:05:26.745785 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:26.745832 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 126.110, Last appended by leader: 110, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.746286 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 127 to 128, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 128 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:26.753705 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 127. Current term is 128. Ops: []
I20260621 08:05:26.753923 11082 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260621 08:05:26.753993 11082 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 128.111 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 110
I20260621 08:05:26.754025 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 LEADER]: Stepping down as leader of term 127
I20260621 08:05:26.754065 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:26.754122 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 127.111, Last appended by leader: 111, Current term: 127, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.754204 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 127 FOLLOWER]: Advancing to term 128
I20260621 08:05:26.821496 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 128 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 126 index: 110. Preceding OpId from leader: term: 128 index: 111. (index mismatch)
I20260621 08:05:26.821827 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260621 08:05:26.822798 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 128 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 127 index: 111. Preceding OpId from leader: term: 128 index: 111. (term mismatch)
I20260621 08:05:26.822852 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 110
I20260621 08:05:26.822870 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 127.111
I20260621 08:05:26.822887 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 128 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:26.823050 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260621 08:05:26.922952 11087 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 128 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:26.923067 11087 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 128 FOLLOWER]: Advancing to term 129
I20260621 08:05:26.923777 11087 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.923944 11087 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 129 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:26.924170 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 129 candidate_status { last_received { term: 128 index: 111 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:26.924170 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 129 candidate_status { last_received { term: 128 index: 111 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:26.924292 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 128 FOLLOWER]: Advancing to term 129
I20260621 08:05:26.924871 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 129 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 129.
I20260621 08:05:26.925055 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 129 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:26.925148 11087 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 FOLLOWER]: Leader election won for term 129
I20260621 08:05:26.925199 11087 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:26.925239 11087 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 128.111, Last appended by leader: 111, Current term: 129, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.925676 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 128 to 129, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 129 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:26.926745 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 128. Current term is 129. Ops: []
I20260621 08:05:26.926916 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 128.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260621 08:05:26.927001 11085 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 129.112 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 111
I20260621 08:05:26.927039 11089 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 LEADER]: Stepping down as leader of term 128
I20260621 08:05:26.927078 11089 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:26.927141 11089 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 128.111, Last appended by leader: 111, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:26.927263 11089 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 128 FOLLOWER]: Advancing to term 129
I20260621 08:05:27.022745 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 129 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 128 index: 111. Preceding OpId from leader: term: 129 index: 112. (index mismatch)
I20260621 08:05:27.023059 11087 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260621 08:05:27.024047 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 129 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 128 index: 111. Preceding OpId from leader: term: 129 index: 112. (index mismatch)
I20260621 08:05:27.024220 11087 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260621 08:05:27.212193 11089 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 129 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:27.212299 11089 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 129 FOLLOWER]: Advancing to term 130
I20260621 08:05:27.213007 11089 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.213165 11089 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 130 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:27.213383 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.213400 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:27.213611 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 130 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:27.213716 11089 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Leader election lost for term 130. Reason: could not achieve majority
I20260621 08:05:27.214704 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 129 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:27.214747 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 129 FOLLOWER]: Advancing to term 130
I20260621 08:05:27.215309 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.215426 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 130 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:27.215562 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.215559 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:27.215653 10725 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 130: Already voted for candidate faa2a97af39849ad8965a6ac2e7db63b in this term.
I20260621 08:05:27.215785 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 130 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:27.215862 11078 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 130 FOLLOWER]: Leader election lost for term 130. Reason: could not achieve majority
I20260621 08:05:27.216625 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 129. Current term is 130. Ops: []
I20260621 08:05:27.216791 11090 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 129.112, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260621 08:05:27.216873 11090 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 LEADER]: Stepping down as leader of term 129
I20260621 08:05:27.216902 11090 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:27.216959 11090 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 129.112, Last appended by leader: 112, Current term: 129, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.217036 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 129 FOLLOWER]: Advancing to term 130
I20260621 08:05:27.331104 11089 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:27.331207 11089 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 130 FOLLOWER]: Advancing to term 131
I20260621 08:05:27.331954 11089 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.332091 11089 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 131 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:27.332324 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 131 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:27.332324 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 131 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.332437 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 130 FOLLOWER]: Advancing to term 131
I20260621 08:05:27.332442 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 130 FOLLOWER]: Advancing to term 131
I20260621 08:05:27.333115 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 131.
I20260621 08:05:27.333115 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 131.
I20260621 08:05:27.333341 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 131 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters:
I20260621 08:05:27.333425 11089 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 FOLLOWER]: Leader election won for term 131
I20260621 08:05:27.333498 11089 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:27.333556 11089 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 129.112, Last appended by leader: 112, Current term: 131, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.333997 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 129 to 131, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 131 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:27.422482 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 131 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 129 index: 112. Preceding OpId from leader: term: 131 index: 113. (index mismatch)
I20260621 08:05:27.422731 11089 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260621 08:05:27.423724 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 131 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 129 index: 112. Preceding OpId from leader: term: 131 index: 113. (index mismatch)
I20260621 08:05:27.423897 11089 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260621 08:05:27.471439 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:27.524801 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 131 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:27.524897 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 131 FOLLOWER]: Advancing to term 132
I20260621 08:05:27.525605 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.525763 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 132 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:27.525945 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 132 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.525952 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 132 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:27.526193 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 132 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:27.526274 11078 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Leader election lost for term 132. Reason: could not achieve majority
I20260621 08:05:27.538727 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 131. Current term is 132. Ops: []
I20260621 08:05:27.539000 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 131.113, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260621 08:05:27.539134 11089 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 LEADER]: Stepping down as leader of term 131
I20260621 08:05:27.539178 11089 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:27.539273 11089 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 131.113, Last appended by leader: 113, Current term: 131, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.539358 11089 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 131 FOLLOWER]: Advancing to term 132
I20260621 08:05:27.609441 11090 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 131 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:27.609531 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 131 FOLLOWER]: Advancing to term 132
I20260621 08:05:27.610168 11090 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.610322 11090 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 132 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:27.610553 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 132 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:27.610577 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 132 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:27.610639 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 132: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:27.611162 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 132.
I20260621 08:05:27.611344 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:27.611457 11090 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 FOLLOWER]: Leader election won for term 132
I20260621 08:05:27.611516 11090 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:27.611572 11090 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 131.113, Last appended by leader: 113, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.611994 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 131 to 132, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 132 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:27.638942 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:27.639034 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 132 FOLLOWER]: Advancing to term 133
I20260621 08:05:27.639719 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.639886 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 133 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:27.640096 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 133 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.640127 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 133 candidate_status { last_received { term: 131 index: 113 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:27.640192 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 132 FOLLOWER]: Advancing to term 133
I20260621 08:05:27.640707 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 133.
I20260621 08:05:27.640928 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:27.641043 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 FOLLOWER]: Leader election won for term 133
I20260621 08:05:27.641173 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:27.641222 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 131.113, Last appended by leader: 113, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.641665 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 132 to 133, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 133 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:27.705341 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 132. Current term is 133. Ops: []
I20260621 08:05:27.705600 11090 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260621 08:05:27.705749 11090 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 133.114 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 113
I20260621 08:05:27.705786 11084 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 LEADER]: Stepping down as leader of term 132
I20260621 08:05:27.705842 11084 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:27.705904 11084 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 132.114, Last appended by leader: 114, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.705978 11084 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 132 FOLLOWER]: Advancing to term 133
I20260621 08:05:27.755069 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 133 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 131 index: 113. Preceding OpId from leader: term: 133 index: 114. (index mismatch)
I20260621 08:05:27.755429 11078 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260621 08:05:27.756454 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 133 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 132 index: 114. Preceding OpId from leader: term: 133 index: 114. (term mismatch)
I20260621 08:05:27.756511 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 113
I20260621 08:05:27.756531 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 132.114
I20260621 08:05:27.756548 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 133 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:27.756827 11091 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260621 08:05:27.856935 11089 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 133 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:27.857084 11089 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 133 FOLLOWER]: Advancing to term 134
I20260621 08:05:27.857774 11089 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.857928 11089 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 134 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:27.858162 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 134 candidate_status { last_received { term: 133 index: 114 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:27.858162 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 134 candidate_status { last_received { term: 133 index: 114 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:27.858291 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 133 FOLLOWER]: Advancing to term 134
I20260621 08:05:27.858891 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 134.
I20260621 08:05:27.859099 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:27.859238 11089 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 FOLLOWER]: Leader election won for term 134
I20260621 08:05:27.859311 11089 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:27.859366 11089 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 133.114, Last appended by leader: 114, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.859800 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 133 to 134, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 134 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:27.868391 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 134 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 133. Current term is 134. Ops: []
I20260621 08:05:27.868635 11092 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 133.114, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260621 08:05:27.868741 11092 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 LEADER]: Stepping down as leader of term 133
I20260621 08:05:27.868777 11092 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:27.868837 11092 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 133.114, Last appended by leader: 114, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:27.868921 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 133 FOLLOWER]: Advancing to term 134
I20260621 08:05:27.955246 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 134 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 133 index: 114. Preceding OpId from leader: term: 134 index: 115. (index mismatch)
I20260621 08:05:27.955557 11089 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260621 08:05:27.956565 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 134 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 133 index: 114. Preceding OpId from leader: term: 134 index: 115. (index mismatch)
I20260621 08:05:27.956848 11093 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260621 08:05:28.057035 11084 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 134 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:28.057139 11084 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 134 FOLLOWER]: Advancing to term 135
I20260621 08:05:28.057833 11084 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.058004 11084 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 135 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:28.058240 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 135 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.058260 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 135 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:28.058494 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 135 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:28.058579 11084 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Leader election lost for term 135. Reason: could not achieve majority
I20260621 08:05:28.068574 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 134. Current term is 135. Ops: []
I20260621 08:05:28.068850 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 134.115, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260621 08:05:28.068953 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 LEADER]: Stepping down as leader of term 134
I20260621 08:05:28.068971 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:28.069017 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 134.115, Last appended by leader: 115, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.069092 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 134 FOLLOWER]: Advancing to term 135
I20260621 08:05:28.135049 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 134 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:28.135175 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 134 FOLLOWER]: Advancing to term 135
I20260621 08:05:28.135848 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.136018 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 135 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:28.136232 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 135 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.136232 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 135 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:28.136360 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 135: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:28.136925 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 135 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 135.
I20260621 08:05:28.137127 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 135 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:28.137241 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 FOLLOWER]: Leader election won for term 135
I20260621 08:05:28.137327 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:28.137385 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 134.115, Last appended by leader: 115, Current term: 135, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.137866 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 134 to 135, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 135 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:28.161913 11084 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:28.161993 11084 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 135 FOLLOWER]: Advancing to term 136
I20260621 08:05:28.162631 11084 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.162791 11084 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 136 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:28.162982 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 136 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.162993 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 136 candidate_status { last_received { term: 134 index: 115 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:28.163064 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 135 FOLLOWER]: Advancing to term 136
I20260621 08:05:28.163652 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 136.
I20260621 08:05:28.163810 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:28.163893 11084 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 FOLLOWER]: Leader election won for term 136
I20260621 08:05:28.163946 11084 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:28.163992 11084 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 134.115, Last appended by leader: 115, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.164388 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 135 to 136, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 136 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:28.237288 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 135. Current term is 136. Ops: []
I20260621 08:05:28.237557 11078 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260621 08:05:28.237668 11078 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 136.116 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 115
I20260621 08:05:28.237702 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 LEADER]: Stepping down as leader of term 135
I20260621 08:05:28.237730 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:28.237790 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 135.116, Last appended by leader: 116, Current term: 135, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.237860 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 135 FOLLOWER]: Advancing to term 136
I20260621 08:05:28.245867 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 136 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 134 index: 115. Preceding OpId from leader: term: 136 index: 116. (index mismatch)
I20260621 08:05:28.246130 11084 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260621 08:05:28.247184 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 136 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 135 index: 116. Preceding OpId from leader: term: 136 index: 116. (term mismatch)
I20260621 08:05:28.247263 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 115
I20260621 08:05:28.247284 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 135.116
I20260621 08:05:28.247303 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 136 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:28.247531 11090 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260621 08:05:28.347518 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 136 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:28.347620 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 136 FOLLOWER]: Advancing to term 137
I20260621 08:05:28.348253 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.348387 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 137 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:28.348641 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 137 candidate_status { last_received { term: 136 index: 116 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:28.348654 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 137 candidate_status { last_received { term: 136 index: 116 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:28.348757 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 136 FOLLOWER]: Advancing to term 137
I20260621 08:05:28.349308 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 137 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 137.
I20260621 08:05:28.349444 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 137 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:28.349525 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 FOLLOWER]: Leader election won for term 137
I20260621 08:05:28.349581 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:28.349627 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 136.116, Last appended by leader: 116, Current term: 137, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.350032 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 136 to 137, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 137 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:28.360194 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 137 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 136. Current term is 137. Ops: []
I20260621 08:05:28.360473 11094 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 136.116, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260621 08:05:28.360576 11094 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 LEADER]: Stepping down as leader of term 136
I20260621 08:05:28.360595 11094 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:28.360642 11094 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 136.116, Last appended by leader: 116, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.360724 11094 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 136 FOLLOWER]: Advancing to term 137
I20260621 08:05:28.435638 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 137 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 136 index: 116. Preceding OpId from leader: term: 137 index: 117. (index mismatch)
I20260621 08:05:28.435912 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260621 08:05:28.436470 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 137 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 136 index: 116. Preceding OpId from leader: term: 137 index: 117. (index mismatch)
I20260621 08:05:28.436678 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260621 08:05:28.471683 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:28.537525 11092 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 137 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:28.537612 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 137 FOLLOWER]: Advancing to term 138
I20260621 08:05:28.538268 11092 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.538424 11092 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 138 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:28.538574 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 138 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.538574 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 138 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:28.538820 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 138 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:28.538906 11092 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Leader election lost for term 138. Reason: could not achieve majority
I20260621 08:05:28.549185 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 137. Current term is 138. Ops: []
I20260621 08:05:28.549413 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 137.117, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260621 08:05:28.549527 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 LEADER]: Stepping down as leader of term 137
I20260621 08:05:28.549554 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:28.549608 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 137.117, Last appended by leader: 117, Current term: 137, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.549685 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 137 FOLLOWER]: Advancing to term 138
I20260621 08:05:28.636377 11094 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 137 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:28.636473 11094 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 137 FOLLOWER]: Advancing to term 138
I20260621 08:05:28.637132 11094 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.637285 11094 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 138 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:28.637488 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 138 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.637488 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 138 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:28.637605 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f in current term 138: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:28.638114 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 138.
I20260621 08:05:28.638290 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:28.638392 11094 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 FOLLOWER]: Leader election won for term 138
I20260621 08:05:28.638444 11094 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:28.638491 11094 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 137.117, Last appended by leader: 117, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.638955 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 137 to 138, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 138 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:28.654634 11092 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:28.654711 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 138 FOLLOWER]: Advancing to term 139
I20260621 08:05:28.655329 11092 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.655470 11092 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 139 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:28.655642 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 139 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:28.655642 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 139 candidate_status { last_received { term: 137 index: 117 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:28.655758 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 138 FOLLOWER]: Advancing to term 139
I20260621 08:05:28.656270 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 139 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 139.
I20260621 08:05:28.656471 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 139 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:28.656576 11092 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 FOLLOWER]: Leader election won for term 139
I20260621 08:05:28.656642 11092 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:28.656697 11092 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 137.117, Last appended by leader: 117, Current term: 139, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.657117 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 138 to 139, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 139 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:28.722250 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 139 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 138. Current term is 139. Ops: []
I20260621 08:05:28.722544 11094 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260621 08:05:28.722685 11094 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 LEADER]: Stepping down as leader of term 138
I20260621 08:05:28.722723 11094 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:28.722790 11094 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 138.118, Last appended by leader: 118, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.722862 11094 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 138 FOLLOWER]: Advancing to term 139
I20260621 08:05:28.744554 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 139 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 138 index: 118. Preceding OpId from leader: term: 139 index: 118. (term mismatch)
I20260621 08:05:28.744638 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 117
I20260621 08:05:28.744653 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 138.118
I20260621 08:05:28.744666 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 139 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:28.744906 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260621 08:05:28.746212 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 139 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 137 index: 117. Preceding OpId from leader: term: 139 index: 118. (index mismatch)
I20260621 08:05:28.746402 11095 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260621 08:05:28.847568 11093 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 139 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:28.847666 11093 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 139 FOLLOWER]: Advancing to term 140
I20260621 08:05:28.848374 11093 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.848528 11093 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 140 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:28.848774 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 140 candidate_status { last_received { term: 139 index: 118 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:28.848809 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 140 candidate_status { last_received { term: 139 index: 118 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:28.848912 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 139 FOLLOWER]: Advancing to term 140
I20260621 08:05:28.849514 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 140.
I20260621 08:05:28.849725 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:28.849845 11093 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 FOLLOWER]: Leader election won for term 140
I20260621 08:05:28.849921 11093 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:28.849974 11093 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 139.118, Last appended by leader: 118, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.850461 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 139 to 140, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 140 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:28.851325 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 139. Current term is 140. Ops: []
I20260621 08:05:28.851502 11092 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 139.118, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260621 08:05:28.851594 11092 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer faa2a97af39849ad8965a6ac2e7db63b log is divergent from this leader: its last log entry 140.119 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 118
I20260621 08:05:28.851631 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 LEADER]: Stepping down as leader of term 139
I20260621 08:05:28.851676 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:28.851729 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 139.118, Last appended by leader: 118, Current term: 139, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:28.851806 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 139 FOLLOWER]: Advancing to term 140
I20260621 08:05:28.927896 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 140 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 139 index: 118. Preceding OpId from leader: term: 140 index: 119. (index mismatch)
I20260621 08:05:28.928155 11093 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260621 08:05:28.929237 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 140 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 139 index: 118. Preceding OpId from leader: term: 140 index: 119. (index mismatch)
I20260621 08:05:28.929466 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260621 08:05:29.030457 11090 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 140 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:29.030634 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 140 FOLLOWER]: Advancing to term 141
I20260621 08:05:29.031559 11090 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.031764 11090 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 141 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.031785 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 140. Current term is 141. Ops: []
I20260621 08:05:29.031912 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.031920 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.031978 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 140.119, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260621 08:05:29.032055 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 LEADER]: Stepping down as leader of term 140
I20260621 08:05:29.032085 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:29.032219 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 141 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:29.032244 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.032306 11090 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Leader election lost for term 141. Reason: could not achieve majority
I20260621 08:05:29.032325 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 140 FOLLOWER]: Advancing to term 141
I20260621 08:05:29.116088 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 140 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:29.116191 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 140 FOLLOWER]: Advancing to term 141
I20260621 08:05:29.116848 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.117002 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 141 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:29.117211 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:29.117215 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.117321 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Leader election vote request: Denying vote to candidate 772d4e03613f477a8c7dbc9bf212f851 in current term 141: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:29.117851 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 141.
I20260621 08:05:29.118031 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:29.118124 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 FOLLOWER]: Leader election won for term 141
I20260621 08:05:29.118180 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:29.118255 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.118736 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 140 to 141, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 141 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:29.167809 11090 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:29.167910 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 141 FOLLOWER]: Advancing to term 142
I20260621 08:05:29.168586 11090 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.168759 11090 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 142 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.169010 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 142 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.169010 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 142 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.169150 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 141 FOLLOWER]: Advancing to term 142
I20260621 08:05:29.169767 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 142 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 142.
I20260621 08:05:29.169940 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 142 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:29.170037 11090 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 FOLLOWER]: Leader election won for term 142
I20260621 08:05:29.170094 11090 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:29.170148 11090 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 142, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.170574 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 141 to 142, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 142 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:29.200208 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 142 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 141. Current term is 142. Ops: []
I20260621 08:05:29.200487 11078 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260621 08:05:29.200608 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 LEADER]: Stepping down as leader of term 141
I20260621 08:05:29.200640 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:29.200696 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 141.120, Last appended by leader: 120, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.200773 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 141 FOLLOWER]: Advancing to term 142
I20260621 08:05:29.276047 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 142 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 140 index: 119. Preceding OpId from leader: term: 142 index: 120. (index mismatch)
I20260621 08:05:29.276389 11090 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260621 08:05:29.277480 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 142 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 141 index: 120. Preceding OpId from leader: term: 142 index: 120. (term mismatch)
I20260621 08:05:29.277541 10877 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting all ops after (but not including) 119
I20260621 08:05:29.277562 10877 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: Aborting uncommitted NO_OP operation due to leader change: 141.120
I20260621 08:05:29.277588 10877 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 142 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:29.277889 11094 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260621 08:05:29.471947 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:29.472431 11092 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 142 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:29.472491 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 142 FOLLOWER]: Advancing to term 143
I20260621 08:05:29.473248 11092 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.473420 11092 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 143 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:29.473654 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.473651 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:29.473938 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 143 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:29.474046 11092 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Leader election lost for term 143. Reason: could not achieve majority
I20260621 08:05:29.479526 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 142. Current term is 143. Ops: []
I20260621 08:05:29.479844 11096 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 142.120, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260621 08:05:29.479945 11090 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 LEADER]: Stepping down as leader of term 142
I20260621 08:05:29.479987 11090 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:29.480062 11090 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 142, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.480140 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 142 FOLLOWER]: Advancing to term 143
I20260621 08:05:29.549616 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 142 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:29.549731 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 142 FOLLOWER]: Advancing to term 143
I20260621 08:05:29.550421 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.550683 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 143 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.550935 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:29.550936 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.551054 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 143: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:29.551656 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 143.
I20260621 08:05:29.551829 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:29.551913 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 FOLLOWER]: Leader election won for term 143
I20260621 08:05:29.552007 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:29.552047 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.552489 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 142 to 143, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 143 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:29.596084 11092 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:29.596176 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 143 FOLLOWER]: Advancing to term 144
I20260621 08:05:29.596877 11092 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.597041 11092 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 144 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:29.597258 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 144 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:29.597277 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 144 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.597323 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 143 FOLLOWER]: Advancing to term 144
I20260621 08:05:29.597932 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 144 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 144.
I20260621 08:05:29.598130 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 144 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:29.598241 11092 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 FOLLOWER]: Leader election won for term 144
I20260621 08:05:29.598313 11092 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:29.598368 11092 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 144, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.598786 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 143 to 144, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 144 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:29.659920 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 143. Current term is 144. Ops: []
I20260621 08:05:29.660209 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260621 08:05:29.660318 11085 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 144.121 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 120
I20260621 08:05:29.660362 11097 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 LEADER]: Stepping down as leader of term 143
I20260621 08:05:29.660413 11097 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:29.660481 11097 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 143.121, Last appended by leader: 121, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.660573 11097 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 143 FOLLOWER]: Advancing to term 144
I20260621 08:05:29.701949 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 144 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 142 index: 120. Preceding OpId from leader: term: 144 index: 121. (index mismatch)
I20260621 08:05:29.702231 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260621 08:05:29.703173 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 144 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 143 index: 121. Preceding OpId from leader: term: 144 index: 121. (term mismatch)
I20260621 08:05:29.703276 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 120
I20260621 08:05:29.703297 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 143.121
I20260621 08:05:29.703434 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 144 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:29.703575 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260621 08:05:29.803678 11090 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 144 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:29.803766 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 144 FOLLOWER]: Advancing to term 145
I20260621 08:05:29.804351 11090 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.804491 11090 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 145 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.804651 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.804654 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.804872 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:29.804960 11090 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260621 08:05:29.821177 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 144. Current term is 145. Ops: []
I20260621 08:05:29.821448 11098 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 144.121, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260621 08:05:29.821578 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 LEADER]: Stepping down as leader of term 144
I20260621 08:05:29.821628 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:29.821681 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 144, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.821794 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 144 FOLLOWER]: Advancing to term 145
I20260621 08:05:29.898092 11097 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 144 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:29.898201 11097 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 144 FOLLOWER]: Advancing to term 145
I20260621 08:05:29.898828 11097 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.898967 11097 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 145 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.899192 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:29.899201 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.899310 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 145: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:29.899894 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 145 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 145.
I20260621 08:05:29.900059 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 145 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:29.900142 11097 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 FOLLOWER]: Leader election won for term 145
I20260621 08:05:29.900193 11097 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:29.900231 11097 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 145, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.900633 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 144 to 145, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 145 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:29.936478 11090 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:29.936580 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 145 FOLLOWER]: Advancing to term 146
I20260621 08:05:29.937206 11090 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.937364 11090 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 146 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:29.937572 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 146 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:29.937666 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 145 FOLLOWER]: Advancing to term 146
I20260621 08:05:29.937574 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 146 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:29.938222 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 146.
I20260621 08:05:29.938392 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:29.938472 11090 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 FOLLOWER]: Leader election won for term 146
I20260621 08:05:29.938524 11090 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:29.938565 11090 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.938984 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 145 to 146, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 146 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:29.993089 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 145. Current term is 146. Ops: []
I20260621 08:05:29.993360 11097 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260621 08:05:29.993476 11097 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 146.122 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 121
I20260621 08:05:29.993510 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 LEADER]: Stepping down as leader of term 145
I20260621 08:05:29.993557 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:29.993613 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 145.122, Last appended by leader: 122, Current term: 145, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:29.993690 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 145 FOLLOWER]: Advancing to term 146
I20260621 08:05:30.026058 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 146 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 145 index: 122. Preceding OpId from leader: term: 146 index: 122. (term mismatch)
I20260621 08:05:30.026135 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 121
I20260621 08:05:30.026149 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 145.122
I20260621 08:05:30.026165 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 146 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:30.026454 11090 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260621 08:05:30.027767 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 146 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 144 index: 121. Preceding OpId from leader: term: 146 index: 122. (index mismatch)
I20260621 08:05:30.027941 11099 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260621 08:05:30.128372 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 146 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:30.128479 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 146 FOLLOWER]: Advancing to term 147
I20260621 08:05:30.129181 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.129339 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 146. Current term is 147. Ops: []
I20260621 08:05:30.129352 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 147 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:30.129467 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:30.129498 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:30.129537 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 146 FOLLOWER]: Advancing to term 147
I20260621 08:05:30.130105 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 147 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 147.
I20260621 08:05:30.130280 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 147 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:30.130292 11090 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 146.122, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260621 08:05:30.130375 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 FOLLOWER]: Leader election won for term 147
I20260621 08:05:30.130417 11099 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 LEADER]: Stepping down as leader of term 146
I20260621 08:05:30.130432 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:30.130455 11099 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:30.130479 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 146.122, Last appended by leader: 122, Current term: 147, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.130525 11099 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 146.122, Last appended by leader: 122, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.130604 11099 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 146 FOLLOWER]: Advancing to term 147
I20260621 08:05:30.130936 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 146 to 147, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 147 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:30.207360 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 147 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 146 index: 122. Preceding OpId from leader: term: 147 index: 123. (index mismatch)
I20260621 08:05:30.207636 11078 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260621 08:05:30.208652 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 147 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 146 index: 122. Preceding OpId from leader: term: 147 index: 123. (index mismatch)
I20260621 08:05:30.208904 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260621 08:05:30.309471 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 147 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:30.309569 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 147 FOLLOWER]: Advancing to term 148
I20260621 08:05:30.310195 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.310336 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 148 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:30.310580 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 148 candidate_status { last_received { term: 147 index: 123 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:30.310580 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 148 candidate_status { last_received { term: 147 index: 123 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:30.310714 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 147 FOLLOWER]: Advancing to term 148
I20260621 08:05:30.311335 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 148 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 148.
I20260621 08:05:30.311510 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 148 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:30.311599 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 FOLLOWER]: Leader election won for term 148
I20260621 08:05:30.311651 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:30.311697 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 147.123, Last appended by leader: 123, Current term: 148, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.312116 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 147 to 148, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 148 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:30.318686 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 148 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 147. Current term is 148. Ops: []
I20260621 08:05:30.318912 11098 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 147.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260621 08:05:30.319047 11092 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 LEADER]: Stepping down as leader of term 147
I20260621 08:05:30.319089 11092 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:30.319141 11092 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 147.123, Last appended by leader: 123, Current term: 147, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.319264 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 147 FOLLOWER]: Advancing to term 148
I20260621 08:05:30.319268 10725 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 LEADER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 147. Current term is 148. Ops: []
I20260621 08:05:30.411751 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 148 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 147 index: 123. Preceding OpId from leader: term: 148 index: 124. (index mismatch)
I20260621 08:05:30.412111 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260621 08:05:30.413291 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 148 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 147 index: 123. Preceding OpId from leader: term: 148 index: 124. (index mismatch)
I20260621 08:05:30.413479 11085 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260621 08:05:30.472208 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:30.514739 11099 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 148 FOLLOWER]: Starting leader election (detected failure of leader faa2a97af39849ad8965a6ac2e7db63b)
I20260621 08:05:30.514844 11099 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 148 FOLLOWER]: Advancing to term 149
I20260621 08:05:30.515580 11099 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.515736 11099 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 149 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:30.515928 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 149 candidate_status { last_received { term: 148 index: 124 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:30.515936 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 149 candidate_status { last_received { term: 148 index: 124 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:30.516032 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 148 FOLLOWER]: Advancing to term 149
I20260621 08:05:30.516561 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 149.
I20260621 08:05:30.516727 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:30.516760 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 148. Current term is 149. Ops: []
I20260621 08:05:30.516870 11099 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 FOLLOWER]: Leader election won for term 149
I20260621 08:05:30.516914 11099 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:30.517017 11099 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 148.124, Last appended by leader: 124, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.516990 11100 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 148.124, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260621 08:05:30.517174 11100 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 LEADER]: Stepping down as leader of term 148
I20260621 08:05:30.517237 11100 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:30.517323 11100 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 148.124, Last appended by leader: 124, Current term: 148, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.517411 11100 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 148 FOLLOWER]: Advancing to term 149
I20260621 08:05:30.517467 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 148 to 149, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 149 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:30.619694 11092 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 149 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:30.619827 11092 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 149 FOLLOWER]: Advancing to term 150
I20260621 08:05:30.620609 11092 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.620775 11092 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 150 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:30.620959 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 150 candidate_status { last_received { term: 148 index: 124 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:30.620965 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 150 candidate_status { last_received { term: 148 index: 124 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:30.621065 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 149 FOLLOWER]: Advancing to term 150
I20260621 08:05:30.621624 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 150 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 150.
I20260621 08:05:30.621800 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 150 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:30.621891 11092 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 FOLLOWER]: Leader election won for term 150
I20260621 08:05:30.621940 11092 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:30.621984 11092 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 148.124, Last appended by leader: 124, Current term: 150, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.622427 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 149 to 150, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 150 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:30.622479 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 149. Current term is 150. Ops: []
I20260621 08:05:30.622658 11099 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260621 08:05:30.622764 11099 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 150.125 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 124
I20260621 08:05:30.622830 11090 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 LEADER]: Stepping down as leader of term 149
I20260621 08:05:30.622877 11090 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:30.622934 11090 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 149.125, Last appended by leader: 125, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.623001 11090 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 149 FOLLOWER]: Advancing to term 150
I20260621 08:05:30.701390 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 150 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 148 index: 124. Preceding OpId from leader: term: 150 index: 125. (index mismatch)
I20260621 08:05:30.701658 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260621 08:05:30.702580 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 150 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 149 index: 125. Preceding OpId from leader: term: 150 index: 125. (term mismatch)
I20260621 08:05:30.702637 10801 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting all ops after (but not including) 124
I20260621 08:05:30.702656 10801 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: Aborting uncommitted NO_OP operation due to leader change: 149.125
I20260621 08:05:30.702673 10801 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 150 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:30.702907 11092 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260621 08:05:30.918771 11099 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 150 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:30.918871 11099 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 150 FOLLOWER]: Advancing to term 151
I20260621 08:05:30.919564 11099 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.919766 11099 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 151 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:30.919977 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 151 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:30.919977 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 151 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:30.920333 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 151 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:30.920428 11099 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Leader election lost for term 151. Reason: could not achieve majority
I20260621 08:05:30.924635 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 150. Current term is 151. Ops: []
I20260621 08:05:30.924902 11078 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 150.125, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260621 08:05:30.925000 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 LEADER]: Stepping down as leader of term 150
I20260621 08:05:30.925032 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:30.925079 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 150.125, Last appended by leader: 125, Current term: 150, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.925148 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 150 FOLLOWER]: Advancing to term 151
I20260621 08:05:30.976495 11100 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 150 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:30.976598 11100 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 150 FOLLOWER]: Advancing to term 151
I20260621 08:05:30.977389 11100 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.977591 11100 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 151 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:30.977823 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 151 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:30.977823 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 151 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:30.977949 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 151: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:30.978466 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 151 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 151.
I20260621 08:05:30.978614 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 151 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:30.978698 11100 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 FOLLOWER]: Leader election won for term 151
I20260621 08:05:30.978761 11100 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:30.978816 11100 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 150.125, Last appended by leader: 125, Current term: 151, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:30.979285 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 150 to 151, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 151 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:31.044986 11099 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:31.045113 11099 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 151 FOLLOWER]: Advancing to term 152
I20260621 08:05:31.045816 11099 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.045998 11099 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 152 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:31.046206 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 152 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:31.046207 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 152 candidate_status { last_received { term: 150 index: 125 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:31.046305 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 151 FOLLOWER]: Advancing to term 152
I20260621 08:05:31.046859 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 152.
I20260621 08:05:31.047051 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:31.047147 11099 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 FOLLOWER]: Leader election won for term 152
I20260621 08:05:31.047197 11099 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:31.047312 11099 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 150.125, Last appended by leader: 125, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.047796 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 151 to 152, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 152 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:31.069591 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 151. Current term is 152. Ops: []
I20260621 08:05:31.069867 11100 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260621 08:05:31.069954 11100 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 152.126 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 125
I20260621 08:05:31.069991 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 LEADER]: Stepping down as leader of term 151
I20260621 08:05:31.070029 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:31.070071 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 151.126, Last appended by leader: 126, Current term: 151, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.070123 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 151 FOLLOWER]: Advancing to term 152
I20260621 08:05:31.123389 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 152 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 151 index: 126. Preceding OpId from leader: term: 152 index: 126. (term mismatch)
I20260621 08:05:31.123473 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 125
I20260621 08:05:31.123486 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 151.126
I20260621 08:05:31.123500 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 152 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:31.123764 11099 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260621 08:05:31.124760 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 152 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 150 index: 125. Preceding OpId from leader: term: 152 index: 126. (index mismatch)
I20260621 08:05:31.124948 11099 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260621 08:05:31.391515 11098 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 152 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:31.391620 11098 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 152 FOLLOWER]: Advancing to term 153
I20260621 08:05:31.392385 11098 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.392577 11098 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 153 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:31.392786 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 153 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:31.392791 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 153 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:31.393018 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:31.393107 11098 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260621 08:05:31.398460 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 152. Current term is 153. Ops: []
I20260621 08:05:31.398671 11102 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 152.126, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260621 08:05:31.398799 11102 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 LEADER]: Stepping down as leader of term 152
I20260621 08:05:31.398834 11102 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:31.398901 11102 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 152.126, Last appended by leader: 126, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.398979 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 152 FOLLOWER]: Advancing to term 153
I20260621 08:05:31.434275 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 152 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:31.434391 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 152 FOLLOWER]: Advancing to term 153
I20260621 08:05:31.435067 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.435264 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 153 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:31.435474 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 153 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:31.435520 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 153 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:31.435618 10877 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 153: Already voted for candidate 772d4e03613f477a8c7dbc9bf212f851 in this term.
I20260621 08:05:31.436108 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 153 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 153.
I20260621 08:05:31.436265 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 153 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:31.436358 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 FOLLOWER]: Leader election won for term 153
I20260621 08:05:31.436415 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:31.436465 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 152.126, Last appended by leader: 126, Current term: 153, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.436950 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 152 to 153, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 153 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:31.472476 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:31.508400 11098 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:31.508497 11098 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 153 FOLLOWER]: Advancing to term 154
I20260621 08:05:31.509155 11098 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.509323 11098 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 154 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:31.509548 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 154 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:31.509616 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 153 FOLLOWER]: Advancing to term 154
I20260621 08:05:31.509553 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 154 candidate_status { last_received { term: 152 index: 126 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:31.510325 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 154.
I20260621 08:05:31.510648 10842 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:31.510757 11098 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 FOLLOWER]: Leader election won for term 154
I20260621 08:05:31.510808 11098 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:31.510859 11098 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 152.126, Last appended by leader: 126, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.511339 10621 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 153 to 154, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 154 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:31.540381 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 153. Current term is 154. Ops: []
I20260621 08:05:31.540668 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260621 08:05:31.540778 11085 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 154.127 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 126
I20260621 08:05:31.540807 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 LEADER]: Stepping down as leader of term 153
I20260621 08:05:31.540822 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:31.540874 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 153.127, Last appended by leader: 127, Current term: 153, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.540946 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 153 FOLLOWER]: Advancing to term 154
I20260621 08:05:31.623926 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 154 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 153 index: 127. Preceding OpId from leader: term: 154 index: 127. (term mismatch)
I20260621 08:05:31.624003 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 126
I20260621 08:05:31.624017 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 153.127
I20260621 08:05:31.624032 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 154 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:31.624243 11098 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260621 08:05:31.625358 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 154 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 152 index: 126. Preceding OpId from leader: term: 154 index: 127. (index mismatch)
I20260621 08:05:31.625587 11103 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260621 08:05:31.924189 11102 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 154 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:31.924301 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 154 FOLLOWER]: Advancing to term 155
I20260621 08:05:31.924984 11102 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.925146 11102 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 155 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:31.925315 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 155 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:31.925318 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 155 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:31.925547 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 155 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:31.925626 11102 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Leader election lost for term 155. Reason: could not achieve majority
I20260621 08:05:31.947590 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 154. Current term is 155. Ops: []
I20260621 08:05:31.947932 11078 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 154.127, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260621 08:05:31.948060 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 LEADER]: Stepping down as leader of term 154
I20260621 08:05:31.948103 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:31.948164 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 154.127, Last appended by leader: 127, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:31.948251 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 154 FOLLOWER]: Advancing to term 155
I20260621 08:05:32.016073 11085 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 154 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:32.016170 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 154 FOLLOWER]: Advancing to term 155
I20260621 08:05:32.016789 11085 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.016927 11085 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 155 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:32.017156 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 155 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:32.017163 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 155 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:32.017251 10801 raft_consensus.cc:2393] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Leader election vote request: Denying vote to candidate faa2a97af39849ad8965a6ac2e7db63b in current term 155: Already voted for candidate 13f448ddc3ad452194e7f31887156e0f in this term.
I20260621 08:05:32.017765 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 155 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 155.
I20260621 08:05:32.017952 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 155 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:32.018031 11085 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 FOLLOWER]: Leader election won for term 155
I20260621 08:05:32.018082 11085 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:32.018126 11085 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 154.127, Last appended by leader: 127, Current term: 155, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.018534 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 154 to 155, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 155 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:32.047114 11102 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:32.047235 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 155 FOLLOWER]: Advancing to term 156
I20260621 08:05:32.047914 11102 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.048066 11102 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 156 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:32.048269 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 156 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:32.048341 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 155 FOLLOWER]: Advancing to term 156
I20260621 08:05:32.048280 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 156 candidate_status { last_received { term: 154 index: 127 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:32.048882 10877 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 156 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13f448ddc3ad452194e7f31887156e0f in term 156.
I20260621 08:05:32.049038 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 156 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, 772d4e03613f477a8c7dbc9bf212f851; no voters: faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:32.049113 11102 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 FOLLOWER]: Leader election won for term 156
I20260621 08:05:32.049221 11102 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 LEADER]: Becoming Leader. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:32.049261 11102 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 154.127, Last appended by leader: 127, Current term: 156, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.049693 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f reported cstate change: term changed from 155 to 156, leader changed from faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193) to 13f448ddc3ad452194e7f31887156e0f (127.10.87.194). New cstate: current_term: 156 leader_uuid: "13f448ddc3ad452194e7f31887156e0f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:32.107012 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 LEADER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 155. Current term is 156. Ops: []
I20260621 08:05:32.107442 11085 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260621 08:05:32.107555 11085 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer 13f448ddc3ad452194e7f31887156e0f log is divergent from this leader: its last log entry 156.128 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 127
I20260621 08:05:32.107594 11100 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 LEADER]: Stepping down as leader of term 155
I20260621 08:05:32.107631 11100 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:32.107709 11100 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 155.128, Last appended by leader: 128, Current term: 155, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.107790 11100 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 155 FOLLOWER]: Advancing to term 156
I20260621 08:05:32.162302 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 156 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 154 index: 127. Preceding OpId from leader: term: 156 index: 128. (index mismatch)
I20260621 08:05:32.162647 11102 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260621 08:05:32.163705 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 156 FOLLOWER]: Refusing update from remote peer 13f448ddc3ad452194e7f31887156e0f: Log matching property violated. Preceding OpId in replica: term: 155 index: 128. Preceding OpId from leader: term: 156 index: 128. (term mismatch)
I20260621 08:05:32.163770 10725 pending_rounds.cc:85] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting all ops after (but not including) 127
I20260621 08:05:32.163792 10725 pending_rounds.cc:107] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: Aborting uncommitted NO_OP operation due to leader change: 155.128
I20260621 08:05:32.163810 10725 raft_consensus.cc:2889] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 156 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:32.163992 11108 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260621 08:05:32.264688 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 156 FOLLOWER]: Starting leader election (detected failure of leader 13f448ddc3ad452194e7f31887156e0f)
I20260621 08:05:32.264813 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 156 FOLLOWER]: Advancing to term 157
I20260621 08:05:32.265475 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.265643 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 157 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:32.265885 10725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 157 candidate_status { last_received { term: 156 index: 128 } } ignore_live_leader: false dest_uuid: "faa2a97af39849ad8965a6ac2e7db63b"
I20260621 08:05:32.265926 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "772d4e03613f477a8c7dbc9bf212f851" candidate_term: 157 candidate_status { last_received { term: 156 index: 128 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:32.265949 10725 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 156 FOLLOWER]: Advancing to term 157
I20260621 08:05:32.266548 10725 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 772d4e03613f477a8c7dbc9bf212f851 in term 157.
I20260621 08:05:32.266757 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 157 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b; no voters: 13f448ddc3ad452194e7f31887156e0f
I20260621 08:05:32.266844 11078 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 FOLLOWER]: Leader election won for term 157
I20260621 08:05:32.266912 11078 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 LEADER]: Becoming Leader. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:32.266965 11078 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 156.128, Last appended by leader: 128, Current term: 157, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.267419 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 reported cstate change: term changed from 156 to 157, leader changed from 13f448ddc3ad452194e7f31887156e0f (127.10.87.194) to 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195). New cstate: current_term: 157 leader_uuid: "772d4e03613f477a8c7dbc9bf212f851" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:32.286716 10877 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 LEADER]: Rejecting Update request from peer 13f448ddc3ad452194e7f31887156e0f for earlier term 156. Current term is 157. Ops: []
I20260621 08:05:32.286966 11108 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: INVALID_TERM, Last received: 156.128, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260621 08:05:32.287070 11108 consensus_queue.cc:1243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [LEADER]: Peer 772d4e03613f477a8c7dbc9bf212f851 log is divergent from this leader: its last log entry 157.129 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 128
I20260621 08:05:32.287106 11102 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 LEADER]: Stepping down as leader of term 156
I20260621 08:05:32.287144 11102 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 LEADER]: Becoming Follower/Learner. State: Replica: 13f448ddc3ad452194e7f31887156e0f, State: Running, Role: LEADER
I20260621 08:05:32.287194 11102 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 156.128, Last appended by leader: 128, Current term: 156, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.287303 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 156 FOLLOWER]: Advancing to term 157
I20260621 08:05:32.365867 10725 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 157 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 156 index: 128. Preceding OpId from leader: term: 157 index: 129. (index mismatch)
I20260621 08:05:32.366119 11078 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260621 08:05:32.367064 10801 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 157 FOLLOWER]: Refusing update from remote peer 772d4e03613f477a8c7dbc9bf212f851: Log matching property violated. Preceding OpId in replica: term: 156 index: 128. Preceding OpId from leader: term: 157 index: 129. (index mismatch)
I20260621 08:05:32.367288 11109 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260621 08:05:32.467658 11100 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 157 FOLLOWER]: Starting leader election (detected failure of leader 772d4e03613f477a8c7dbc9bf212f851)
I20260621 08:05:32.467761 11100 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 157 FOLLOWER]: Advancing to term 158
I20260621 08:05:32.468482 11100 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.468631 11100 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 158 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:32.468883 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 158 candidate_status { last_received { term: 157 index: 129 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:32.468888 10801 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "faa2a97af39849ad8965a6ac2e7db63b" candidate_term: 158 candidate_status { last_received { term: 157 index: 129 } } ignore_live_leader: false dest_uuid: "13f448ddc3ad452194e7f31887156e0f"
I20260621 08:05:32.468999 10801 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 157 FOLLOWER]: Advancing to term 158
I20260621 08:05:32.469565 10801 raft_consensus.cc:2468] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 158 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faa2a97af39849ad8965a6ac2e7db63b in term 158.
I20260621 08:05:32.469713 10690 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [CANDIDATE]: Term 158 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b; no voters: 772d4e03613f477a8c7dbc9bf212f851
I20260621 08:05:32.469830 11100 raft_consensus.cc:2804] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 FOLLOWER]: Leader election won for term 158
I20260621 08:05:32.469878 11100 raft_consensus.cc:697] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 LEADER]: Becoming Leader. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:32.469914 11100 consensus_queue.cc:237] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 157.129, Last appended by leader: 129, Current term: 158, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.470336 10619 catalog_manager.cc:5696] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b reported cstate change: term changed from 157 to 158, leader changed from 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195) to faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193). New cstate: current_term: 158 leader_uuid: "faa2a97af39849ad8965a6ac2e7db63b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:32.472687 10591 timestamp_advancement-itest.cc:267] GCing logs...
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:267: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/timestamp_advancement-itest.cc:332: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
Actual: it does.
I20260621 08:05:32.472971 10591 tablet_server.cc:179] TabletServer@127.10.87.193:0 shutting down...
W20260621 08:05:32.478384 10843 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260621 08:05:32.478680 10843 consensus_peers.cc:597] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 -> Peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499): Couldn't send request to peer faa2a97af39849ad8965a6ac2e7db63b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260621 08:05:32.492499 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 158 FOLLOWER]: Rejecting Update request from peer 772d4e03613f477a8c7dbc9bf212f851 for earlier term 157. Current term is 158. Ops: []
I20260621 08:05:32.492724 11098 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 157.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260621 08:05:32.492862 11078 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 LEADER]: Stepping down as leader of term 157
I20260621 08:05:32.492913 11078 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 LEADER]: Becoming Follower/Learner. State: Replica: 772d4e03613f477a8c7dbc9bf212f851, State: Running, Role: LEADER
I20260621 08:05:32.492965 11078 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 157.129, Last appended by leader: 129, Current term: 157, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.493052 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 157 FOLLOWER]: Advancing to term 158
I20260621 08:05:32.577124 11102 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 158 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:32.577229 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 158 FOLLOWER]: Advancing to term 159
I20260621 08:05:32.577749 10877 raft_consensus.cc:1275] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 158 FOLLOWER]: Refusing update from remote peer faa2a97af39849ad8965a6ac2e7db63b: Log matching property violated. Preceding OpId in replica: term: 157 index: 129. Preceding OpId from leader: term: 158 index: 130. (index mismatch)
I20260621 08:05:32.577999 11100 consensus_queue.cc:1048] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Connected to new peer: Peer: permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260621 08:05:32.578051 11102 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.578190 11102 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 159 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:32.578357 10878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 159 candidate_status { last_received { term: 157 index: 129 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
W20260621 08:05:32.578758 10767 leader_election.cc:336] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 159 election: RPC error from VoteRequest() call to peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260621 08:05:32.578815 10767 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 159 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:32.578948 11102 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 159 FOLLOWER]: Leader election lost for term 159. Reason: could not achieve majority
I20260621 08:05:32.579124 10801 raft_consensus.cc:1240] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 159 FOLLOWER]: Rejecting Update request from peer faa2a97af39849ad8965a6ac2e7db63b for earlier term 158. Current term is 159. Ops: []
I20260621 08:05:32.579293 11100 consensus_queue.cc:1059] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 }, Status: INVALID_TERM, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260621 08:05:32.579380 11085 raft_consensus.cc:3055] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 LEADER]: Stepping down as leader of term 158
I20260621 08:05:32.579427 11085 raft_consensus.cc:740] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 LEADER]: Becoming Follower/Learner. State: Replica: faa2a97af39849ad8965a6ac2e7db63b, State: Running, Role: LEADER
I20260621 08:05:32.579473 11085 consensus_queue.cc:260] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 158.130, Last appended by leader: 130, Current term: 158, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.579536 11085 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 158 FOLLOWER]: Advancing to term 159
I20260621 08:05:32.690600 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:32.690810 10591 tablet_replica.cc:333] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b: stopping tablet replica
I20260621 08:05:32.690910 10591 raft_consensus.cc:2243] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 159 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:32.690984 10591 raft_consensus.cc:2272] T 23a038f11d1b4a78a8a4220145ac5763 P faa2a97af39849ad8965a6ac2e7db63b [term 159 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:32.693111 10591 tablet_server.cc:196] TabletServer@127.10.87.193:0 shutdown complete.
I20260621 08:05:32.694365 10591 tablet_server.cc:179] TabletServer@127.10.87.194:0 shutting down...
I20260621 08:05:32.705305 11102 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 159 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:32.705376 11102 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 159 FOLLOWER]: Advancing to term 160
I20260621 08:05:32.705979 11102 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.706133 11102 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 160 election: Requested vote from peers faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499), 772d4e03613f477a8c7dbc9bf212f851 (127.10.87.195:35497)
I20260621 08:05:32.706317 10877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23a038f11d1b4a78a8a4220145ac5763" candidate_uuid: "13f448ddc3ad452194e7f31887156e0f" candidate_term: 160 candidate_status { last_received { term: 157 index: 129 } } ignore_live_leader: false dest_uuid: "772d4e03613f477a8c7dbc9bf212f851"
I20260621 08:05:32.706373 10877 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 158 FOLLOWER]: Advancing to term 160
W20260621 08:05:32.706701 10767 leader_election.cc:336] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 160 election: RPC error from VoteRequest() call to peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499): Network error: Client connection negotiation failed: client connection to 127.10.87.193:39499: connect: Connection refused (error 111)
I20260621 08:05:32.707005 10877 raft_consensus.cc:2410] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 160 FOLLOWER]: Leader election vote request: Denying vote to candidate 13f448ddc3ad452194e7f31887156e0f for term 160 because replica has last-logged OpId of term: 158 index: 130, which is greater than that of the candidate, which has last-logged OpId of term: 157 index: 129.
I20260621 08:05:32.707173 10766 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [CANDIDATE]: Term 160 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13f448ddc3ad452194e7f31887156e0f; no voters: 772d4e03613f477a8c7dbc9bf212f851, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:32.707293 11102 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 160 FOLLOWER]: Leader election lost for term 160. Reason: could not achieve majority
I20260621 08:05:32.718613 11078 raft_consensus.cc:493] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 160 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:32.718699 11078 raft_consensus.cc:3060] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 160 FOLLOWER]: Advancing to term 161
I20260621 08:05:32.719348 11078 raft_consensus.cc:515] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13f448ddc3ad452194e7f31887156e0f" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33955 } } peers { permanent_uuid: "faa2a97af39849ad8965a6ac2e7db63b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 39499 } } peers { permanent_uuid: "772d4e03613f477a8c7dbc9bf212f851" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 35497 } }
I20260621 08:05:32.719491 11078 leader_election.cc:290] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 161 election: Requested vote from peers 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955), faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499)
I20260621 08:05:32.719746 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:32.719852 10591 tablet_replica.cc:333] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f: stopping tablet replica
I20260621 08:05:32.719908 10591 raft_consensus.cc:2243] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 160 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:32.719945 10591 raft_consensus.cc:2272] T 23a038f11d1b4a78a8a4220145ac5763 P 13f448ddc3ad452194e7f31887156e0f [term 160 FOLLOWER]: Raft consensus is shut down!
W20260621 08:05:32.720208 10842 leader_election.cc:336] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 161 election: RPC error from VoteRequest() call to peer 13f448ddc3ad452194e7f31887156e0f (127.10.87.194:33955): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260621 08:05:32.720271 10843 leader_election.cc:336] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 161 election: RPC error from VoteRequest() call to peer faa2a97af39849ad8965a6ac2e7db63b (127.10.87.193:39499): Network error: Client connection negotiation failed: client connection to 127.10.87.193:39499: connect: Connection refused (error 111)
I20260621 08:05:32.720317 10843 leader_election.cc:304] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [CANDIDATE]: Term 161 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 772d4e03613f477a8c7dbc9bf212f851; no voters: 13f448ddc3ad452194e7f31887156e0f, faa2a97af39849ad8965a6ac2e7db63b
I20260621 08:05:32.720410 11078 raft_consensus.cc:2749] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 161 FOLLOWER]: Leader election lost for term 161. Reason: could not achieve majority
I20260621 08:05:32.731791 10591 tablet_server.cc:196] TabletServer@127.10.87.194:0 shutdown complete.
I20260621 08:05:32.732573 10591 tablet_server.cc:179] TabletServer@127.10.87.195:0 shutting down...
I20260621 08:05:32.741866 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:32.742108 10591 tablet_replica.cc:333] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851: stopping tablet replica
I20260621 08:05:32.742170 10591 raft_consensus.cc:2243] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 161 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:32.742223 10591 raft_consensus.cc:2272] T 23a038f11d1b4a78a8a4220145ac5763 P 772d4e03613f477a8c7dbc9bf212f851 [term 161 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:32.754266 10591 tablet_server.cc:196] TabletServer@127.10.87.195:0 shutdown complete.
I20260621 08:05:32.755501 10591 master.cc:562] Master@127.10.87.254:42931 shutting down...
I20260621 08:05:32.887706 10591 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:32.887821 10591 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:32.887858 10591 tablet_replica.cc:333] T 00000000000000000000000000000000 P aac670c993ac4826ad58623a1f2e1705: stopping tablet replica
I20260621 08:05:32.899775 10591 master.cc:584] Master@127.10.87.254:42931 shutdown complete.
I20260621 08:05:32.901592 10591 test_util.cc:182] -----------------------------------------------
I20260621 08:05:32.901644 10591 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1782029100336519-10591-0
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (32560 ms)
[ RUN ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260621 08:05:32.902130 10591 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.87.254:46841
I20260621 08:05:32.902287 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:32.903714 11115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.903827 11116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.903834 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:32.904009 11118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.904120 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:32.904155 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:32.904167 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029132904168 us; error 0 us; skew 500 ppm
I20260621 08:05:32.904655 10591 webserver.cc:533] Webserver started at http://127.10.87.254:45199/ using document root <none> and password file <none>
I20260621 08:05:32.904729 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:32.904803 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:32.904852 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:32.905098 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/master-0-root/instance:
uuid: "88e53c38e29c4fbaaf9e9a8c502da537"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.905891 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:32.906337 11123 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.906448 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.906490 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/master-0-root
uuid: "88e53c38e29c4fbaaf9e9a8c502da537"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.906534 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:32.917603 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:32.917771 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:32.920398 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.254:46841
I20260621 08:05:32.921993 11176 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.254:46841 every 8 connection(s)
I20260621 08:05:32.922116 11177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:32.923056 11177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537: Bootstrap starting.
I20260621 08:05:32.923381 11177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:32.923851 11177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537: No bootstrap required, opened a new log
I20260621 08:05:32.923959 11177 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER }
I20260621 08:05:32.924002 11177 raft_consensus.cc:385] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:32.924015 11177 raft_consensus.cc:740] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88e53c38e29c4fbaaf9e9a8c502da537, State: Initialized, Role: FOLLOWER
I20260621 08:05:32.924050 11177 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER }
I20260621 08:05:32.924086 11177 raft_consensus.cc:399] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:32.924111 11177 raft_consensus.cc:493] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:32.924136 11177 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:32.924604 11177 raft_consensus.cc:515] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER }
I20260621 08:05:32.924654 11177 leader_election.cc:304] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88e53c38e29c4fbaaf9e9a8c502da537; no voters:
I20260621 08:05:32.924736 11177 leader_election.cc:290] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260621 08:05:32.924808 11180 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:32.924893 11177 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [sys.catalog]: configured and running, proceeding with master startup.
I20260621 08:05:32.924906 11180 raft_consensus.cc:697] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 1 LEADER]: Becoming Leader. State: Replica: 88e53c38e29c4fbaaf9e9a8c502da537, State: Running, Role: LEADER
I20260621 08:05:32.924947 11180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER }
I20260621 08:05:32.925160 11182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88e53c38e29c4fbaaf9e9a8c502da537. Latest consensus state: current_term: 1 leader_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER } }
I20260621 08:05:32.925149 11181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88e53c38e29c4fbaaf9e9a8c502da537" member_type: VOTER } }
I20260621 08:05:32.925240 11182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:32.925249 11181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:32.925477 11185 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260621 08:05:32.925643 11185 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260621 08:05:32.926192 10591 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260621 08:05:32.926227 11185 catalog_manager.cc:1382] Generated new cluster ID: 3cfbc7f6d50844efa47e0b226485d6ea
I20260621 08:05:32.926292 11185 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260621 08:05:32.930182 11185 catalog_manager.cc:1405] Generated new certificate authority record
I20260621 08:05:32.930632 11185 catalog_manager.cc:1539] Loading token signing keys...
I20260621 08:05:32.936216 11185 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537: Generated new TSK 0
I20260621 08:05:32.936300 11185 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260621 08:05:32.941890 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:32.942013 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:32.943185 11199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.943193 11198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.943300 11201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.943317 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:32.943529 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:32.943562 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:32.943579 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029132943580 us; error 0 us; skew 500 ppm
I20260621 08:05:32.944105 10591 webserver.cc:533] Webserver started at http://127.10.87.193:34225/ using document root <none> and password file <none>
I20260621 08:05:32.944183 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:32.944229 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:32.944275 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:32.944520 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root/instance:
uuid: "62dfd87f1926430f909686c71f3e07cd"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.945356 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:32.945798 11206 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.945931 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.945971 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "62dfd87f1926430f909686c71f3e07cd"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.946014 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:32.972402 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:32.972604 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:32.972745 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:32.972946 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:32.972972 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.973008 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:32.973034 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.975574 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:33405
I20260621 08:05:32.975637 11269 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:33405 every 8 connection(s)
I20260621 08:05:32.975936 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:32.976040 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:32.977140 11275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.977303 11274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.977378 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:32.977438 11277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.977591 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:32.977627 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:32.977644 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029132977644 us; error 0 us; skew 500 ppm
I20260621 08:05:32.978156 10591 webserver.cc:533] Webserver started at http://127.10.87.194:38837/ using document root <none> and password file <none>
I20260621 08:05:32.978242 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:32.978296 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:32.978341 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:32.978629 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-1-root/instance:
uuid: "059233fd6be44dd69800dba0818222c8"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.979409 11270 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46841
I20260621 08:05:32.979470 11270 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:32.979583 11270 heartbeater.cc:507] Master 127.10.87.254:46841 requested a full tablet report, sending...
I20260621 08:05:32.979768 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:32.979820 11141 ts_manager.cc:194] Registered new tserver with Master: 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:32.980237 11282 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.980345 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.980391 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-1-root
uuid: "059233fd6be44dd69800dba0818222c8"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.980436 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:32.980504 11141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48910
I20260621 08:05:32.991654 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:32.991834 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:32.991955 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:32.992120 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:32.992146 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.992172 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:32.992195 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.994896 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.194:46681
I20260621 08:05:32.994959 11346 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.194:46681 every 8 connection(s)
I20260621 08:05:32.995294 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:32.995435 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:32.996577 11351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.996599 11350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:32.996773 11353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:32.996928 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:32.997046 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:32.997079 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:32.997097 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029132997096 us; error 0 us; skew 500 ppm
I20260621 08:05:32.997668 10591 webserver.cc:533] Webserver started at http://127.10.87.195:33939/ using document root <none> and password file <none>
I20260621 08:05:32.997752 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:32.997799 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:32.997843 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:32.998155 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-2-root/instance:
uuid: "011c8d128c6c486988112a63d930061c"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.998178 11347 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46841
I20260621 08:05:32.998231 11347 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:32.998342 11347 heartbeater.cc:507] Master 127.10.87.254:46841 requested a full tablet report, sending...
I20260621 08:05:32.998551 11141 ts_manager.cc:194] Registered new tserver with Master: 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681)
I20260621 08:05:32.998884 11141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48914
I20260621 08:05:32.999080 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:32.999574 11358 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.999665 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:32.999711 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-2-root
uuid: "011c8d128c6c486988112a63d930061c"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:32.999752 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:33.020991 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:33.021221 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:33.021384 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:33.021552 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:33.021579 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:33.021615 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:33.021639 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:33.024624 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.195:40875
I20260621 08:05:33.024669 11421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.195:40875 every 8 connection(s)
I20260621 08:05:33.027634 11422 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46841
I20260621 08:05:33.027694 11422 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:33.027807 11422 heartbeater.cc:507] Master 127.10.87.254:46841 requested a full tablet report, sending...
I20260621 08:05:33.028048 11141 ts_manager.cc:194] Registered new tserver with Master: 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.028065 10591 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003311405s
I20260621 08:05:33.028525 11141 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48920
I20260621 08:05:33.038604 11141 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48932:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260621 08:05:33.038754 11141 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 08:05:33.042850 11310 tablet_service.cc:1511] Processing CreateTablet for tablet f485a1cfea0e43bb90ab24b5a453d01d (DEFAULT_TABLE table=test-workload [id=140af9cc936b4627807d24651ef425c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:33.042991 11310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f485a1cfea0e43bb90ab24b5a453d01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:33.043506 11386 tablet_service.cc:1511] Processing CreateTablet for tablet f485a1cfea0e43bb90ab24b5a453d01d (DEFAULT_TABLE table=test-workload [id=140af9cc936b4627807d24651ef425c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:33.043606 11386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f485a1cfea0e43bb90ab24b5a453d01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:33.044402 11443 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Bootstrap starting.
I20260621 08:05:33.044840 11443 tablet_bootstrap.cc:654] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:33.045082 11234 tablet_service.cc:1511] Processing CreateTablet for tablet f485a1cfea0e43bb90ab24b5a453d01d (DEFAULT_TABLE table=test-workload [id=140af9cc936b4627807d24651ef425c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:33.045172 11234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f485a1cfea0e43bb90ab24b5a453d01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:33.045185 11444 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: Bootstrap starting.
I20260621 08:05:33.045435 11443 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: No bootstrap required, opened a new log
I20260621 08:05:33.045480 11443 ts_tablet_manager.cc:1403] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:33.045619 11444 tablet_bootstrap.cc:654] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:33.045614 11443 raft_consensus.cc:359] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.045681 11443 raft_consensus.cc:385] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:33.045701 11443 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Initialized, Role: FOLLOWER
I20260621 08:05:33.045751 11443 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.045912 11443 ts_tablet_manager.cc:1434] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:33.045939 11347 heartbeater.cc:499] Master 127.10.87.254:46841 was elected leader, sending a full tablet report...
I20260621 08:05:33.046101 11444 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: No bootstrap required, opened a new log
I20260621 08:05:33.046146 11444 ts_tablet_manager.cc:1403] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:33.046291 11444 raft_consensus.cc:359] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.046350 11444 raft_consensus.cc:385] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:33.046370 11444 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 011c8d128c6c486988112a63d930061c, State: Initialized, Role: FOLLOWER
I20260621 08:05:33.046418 11448 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Bootstrap starting.
I20260621 08:05:33.046411 11444 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.046630 11444 ts_tablet_manager.cc:1434] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:33.046700 11422 heartbeater.cc:499] Master 127.10.87.254:46841 was elected leader, sending a full tablet report...
I20260621 08:05:33.047158 11448 tablet_bootstrap.cc:654] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:33.047704 11448 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: No bootstrap required, opened a new log
I20260621 08:05:33.047742 11448 ts_tablet_manager.cc:1403] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:33.047875 11448 raft_consensus.cc:359] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.047926 11448 raft_consensus.cc:385] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:33.047940 11448 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Initialized, Role: FOLLOWER
I20260621 08:05:33.047983 11448 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.048141 11448 ts_tablet_manager.cc:1434] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260621 08:05:33.048195 11270 heartbeater.cc:499] Master 127.10.87.254:46841 was elected leader, sending a full tablet report...
I20260621 08:05:33.068177 11451 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 08:05:33.068281 11451 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.068475 11451 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.070823 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8" is_pre_election: true
I20260621 08:05:33.070840 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c" is_pre_election: true
I20260621 08:05:33.070899 11320 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 0.
I20260621 08:05:33.070923 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 0.
I20260621 08:05:33.071024 11209 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd; no voters:
I20260621 08:05:33.071108 11451 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 08:05:33.071151 11451 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:33.071172 11451 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:33.071756 11451 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.071869 11451 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 1 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.072000 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:33.072013 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:33.072048 11320 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:33.072063 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:33.072602 11320 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 1.
I20260621 08:05:33.072678 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 1.
I20260621 08:05:33.072757 11209 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd; no voters:
I20260621 08:05:33.072834 11451 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:33.072953 11451 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 LEADER]: Becoming Leader. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:33.072999 11451 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.073494 11141 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd reported cstate change: term changed from 0 to 1, leader changed from <none> to 62dfd87f1926430f909686c71f3e07cd (127.10.87.193). New cstate: current_term: 1 leader_uuid: "62dfd87f1926430f909686c71f3e07cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:33.080437 11396 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 1 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 08:05:33.080447 11320 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 1 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 08:05:33.080633 11453 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:33.080717 11451 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:33.081897 11460 mvcc.cc:204] Tried to move back new op lower bound from 7299191329096425472 to 7299191329067540480. Current Snapshot: MvccSnapshot[applied={T|T < 7299191329096425472}]
I20260621 08:05:33.397786 11449 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62dfd87f1926430f909686c71f3e07cd)
I20260621 08:05:33.397900 11449 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:33.398583 11449 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.398794 11449 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 2 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:33.401404 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:33.401414 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:33.401681 11359 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 011c8d128c6c486988112a63d930061c; no voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:33.401811 11449 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260621 08:05:33.415596 11396 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Rejecting Update request from peer 62dfd87f1926430f909686c71f3e07cd for earlier term 1. Current term is 2. Ops: []
I20260621 08:05:33.415884 11453 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 1.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:33.456135 11451 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 LEADER]: Stepping down as leader of term 1
I20260621 08:05:33.456238 11451 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:33.456318 11451 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.456449 11451 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:33.484107 11446 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62dfd87f1926430f909686c71f3e07cd)
I20260621 08:05:33.484211 11446 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:33.484969 11446 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.485167 11446 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 2 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.487759 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:33.487869 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:33.487952 11396 raft_consensus.cc:2393] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 059233fd6be44dd69800dba0818222c8 in current term 2: Already voted for candidate 011c8d128c6c486988112a63d930061c in this term.
I20260621 08:05:33.488477 11244 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059233fd6be44dd69800dba0818222c8 in term 2.
I20260621 08:05:33.488632 11283 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd; no voters: 011c8d128c6c486988112a63d930061c
I20260621 08:05:33.488713 11446 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260621 08:05:33.488802 11446 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 LEADER]: Becoming Leader. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:33.488857 11446 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.489250 11138 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 reported cstate change: term changed from 1 to 2, leader changed from 62dfd87f1926430f909686c71f3e07cd (127.10.87.193) to 059233fd6be44dd69800dba0818222c8 (127.10.87.194). New cstate: current_term: 2 leader_uuid: "059233fd6be44dd69800dba0818222c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:33.550261 11449 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:33.550349 11449 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:33.550979 11449 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.551134 11449 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 3 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:33.551353 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 3 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:33.551352 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 3 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:33.551458 11244 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:33.552009 11244 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 011c8d128c6c486988112a63d930061c in term 3.
I20260621 08:05:33.552183 11359 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 011c8d128c6c486988112a63d930061c, 62dfd87f1926430f909686c71f3e07cd; no voters: 059233fd6be44dd69800dba0818222c8
I20260621 08:05:33.552268 11449 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 FOLLOWER]: Leader election won for term 3
I20260621 08:05:33.552358 11449 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 LEADER]: Becoming Leader. State: Replica: 011c8d128c6c486988112a63d930061c, State: Running, Role: LEADER
I20260621 08:05:33.552402 11449 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.570756 11396 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 LEADER]: Rejecting Update request from peer 059233fd6be44dd69800dba0818222c8 for earlier term 2. Current term is 3. Ops: []
I20260621 08:05:33.571058 11446 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:33.571171 11446 consensus_queue.cc:1243] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer 011c8d128c6c486988112a63d930061c log is divergent from this leader: its last log entry 3.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260621 08:05:33.584674 11244 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 3 FOLLOWER]: Rejecting Update request from peer 059233fd6be44dd69800dba0818222c8 for earlier term 2. Current term is 3. Ops: []
I20260621 08:05:33.584908 11479 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:33.588143 11139 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c reported cstate change: term changed from 2 to 3, leader changed from 059233fd6be44dd69800dba0818222c8 (127.10.87.194) to 011c8d128c6c486988112a63d930061c (127.10.87.195). New cstate: current_term: 3 leader_uuid: "011c8d128c6c486988112a63d930061c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:33.642320 11446 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260621 08:05:33.642403 11446 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:33.642464 11446 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.18, Last appended by leader: 18, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.642575 11446 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 2 FOLLOWER]: Advancing to term 3
I20260621 08:05:33.660280 11320 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 3 FOLLOWER]: Refusing update from remote peer 011c8d128c6c486988112a63d930061c: Log matching property violated. Preceding OpId in replica: term: 2 index: 18. Preceding OpId from leader: term: 3 index: 18. (term mismatch)
I20260621 08:05:33.660356 11320 pending_rounds.cc:85] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Aborting all ops after (but not including) 17
I20260621 08:05:33.660370 11320 pending_rounds.cc:107] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: Aborting uncommitted NO_OP operation due to leader change: 2.18
I20260621 08:05:33.660384 11320 raft_consensus.cc:2889] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260621 08:05:33.660620 11449 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Connected to new peer: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:33.666307 11244 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 3 FOLLOWER]: Refusing update from remote peer 011c8d128c6c486988112a63d930061c: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260621 08:05:33.666530 11480 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Connected to new peer: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:33.861451 11451 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 011c8d128c6c486988112a63d930061c)
I20260621 08:05:33.861554 11451 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:33.862182 11451 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.862361 11451 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 4 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.862571 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:33.862638 11244 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Rejecting Update request from peer 011c8d128c6c486988112a63d930061c for earlier term 3. Current term is 4. Ops: []
I20260621 08:05:33.862618 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:33.862936 11209 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62dfd87f1926430f909686c71f3e07cd; no voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8
I20260621 08:05:33.862990 11485 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:33.863032 11451 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260621 08:05:33.933534 11446 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 011c8d128c6c486988112a63d930061c)
I20260621 08:05:33.933634 11446 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:33.934309 11446 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.934484 11446 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 4 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.934691 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:33.934695 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:33.934832 11244 raft_consensus.cc:2393] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 059233fd6be44dd69800dba0818222c8 in current term 4: Already voted for candidate 62dfd87f1926430f909686c71f3e07cd in this term.
I20260621 08:05:33.934995 11283 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 059233fd6be44dd69800dba0818222c8; no voters: 011c8d128c6c486988112a63d930061c, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:33.935089 11446 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260621 08:05:33.957126 11320 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 4 FOLLOWER]: Rejecting Update request from peer 011c8d128c6c486988112a63d930061c for earlier term 3. Current term is 4. Ops: []
I20260621 08:05:33.957384 11480 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:33.967236 11485 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 LEADER]: Stepping down as leader of term 3
I20260621 08:05:33.967357 11485 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 011c8d128c6c486988112a63d930061c, State: Running, Role: LEADER
I20260621 08:05:33.967442 11485 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.967576 11485 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 3 FOLLOWER]: Advancing to term 4
I20260621 08:05:33.976495 11451 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:33.976573 11451 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:33.977170 11451 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.977339 11451 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 5 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:33.977538 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:33.977540 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:33.977638 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:33.977641 11320 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 4 FOLLOWER]: Advancing to term 5
I20260621 08:05:33.978297 11320 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 5.
I20260621 08:05:33.978358 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 5.
I20260621 08:05:33.978478 11209 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd; no voters:
I20260621 08:05:33.978579 11451 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 FOLLOWER]: Leader election won for term 5
I20260621 08:05:33.978677 11451 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 LEADER]: Becoming Leader. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:33.978724 11451 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:33.979199 11139 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd reported cstate change: term changed from 3 to 5, leader changed from 011c8d128c6c486988112a63d930061c (127.10.87.195) to 62dfd87f1926430f909686c71f3e07cd (127.10.87.193). New cstate: current_term: 5 leader_uuid: "62dfd87f1926430f909686c71f3e07cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:34.059713 11320 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 5 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260621 08:05:34.060009 11451 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:34.062181 11396 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 5 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260621 08:05:34.062383 11487 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:34.162919 11446 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 62dfd87f1926430f909686c71f3e07cd)
I20260621 08:05:34.163014 11446 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:34.163805 11446 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.163959 11320 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 FOLLOWER]: Rejecting Update request from peer 62dfd87f1926430f909686c71f3e07cd for earlier term 5. Current term is 6. Ops: []
I20260621 08:05:34.163973 11446 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 6 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:34.164091 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:34.164101 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:34.164228 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:34.164219 11486 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:34.164847 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059233fd6be44dd69800dba0818222c8 in term 6.
I20260621 08:05:34.165032 11286 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8; no voters: 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:34.165140 11446 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 FOLLOWER]: Leader election won for term 6
I20260621 08:05:34.165261 11446 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 LEADER]: Becoming Leader. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:34.165320 11446 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.165648 11396 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 6 FOLLOWER]: Rejecting Update request from peer 62dfd87f1926430f909686c71f3e07cd for earlier term 5. Current term is 6. Ops: []
I20260621 08:05:34.165830 11451 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:34.165792 11140 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 reported cstate change: term changed from 5 to 6, leader changed from 62dfd87f1926430f909686c71f3e07cd (127.10.87.193) to 059233fd6be44dd69800dba0818222c8 (127.10.87.194). New cstate: current_term: 6 leader_uuid: "059233fd6be44dd69800dba0818222c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:34.239454 11486 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 LEADER]: Stepping down as leader of term 5
I20260621 08:05:34.239549 11486 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:34.239629 11486 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.239737 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 5 FOLLOWER]: Advancing to term 6
I20260621 08:05:34.248207 11396 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 6 FOLLOWER]: Refusing update from remote peer 059233fd6be44dd69800dba0818222c8: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 6 index: 20. (index mismatch)
I20260621 08:05:34.248469 11446 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:34.273739 11244 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 6 FOLLOWER]: Refusing update from remote peer 059233fd6be44dd69800dba0818222c8: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 6 index: 20. (index mismatch)
I20260621 08:05:34.273973 11446 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:34.350080 11485 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 059233fd6be44dd69800dba0818222c8)
I20260621 08:05:34.350179 11485 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:34.350847 11485 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.351001 11485 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 7 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:34.351182 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 7 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:34.351138 11396 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 7 FOLLOWER]: Rejecting Update request from peer 059233fd6be44dd69800dba0818222c8 for earlier term 6. Current term is 7. Ops: []
I20260621 08:05:34.351135 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 7 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:34.351493 11361 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 011c8d128c6c486988112a63d930061c; no voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:34.351503 11446 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 6.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260621 08:05:34.351600 11485 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260621 08:05:34.376717 11489 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 LEADER]: Stepping down as leader of term 6
I20260621 08:05:34.376827 11489 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:34.376886 11489 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 6.20, Last appended by leader: 20, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.376978 11489 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:34.467944 11485 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:34.468065 11485 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:34.468688 11485 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.468861 11485 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 8 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:34.469053 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 8 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:34.469066 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 8 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:34.469146 11320 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:34.469686 11320 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 011c8d128c6c486988112a63d930061c in term 8.
I20260621 08:05:34.469821 11361 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8; no voters: 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:34.469901 11485 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 FOLLOWER]: Leader election won for term 8
I20260621 08:05:34.469998 11485 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 LEADER]: Becoming Leader. State: Replica: 011c8d128c6c486988112a63d930061c, State: Running, Role: LEADER
I20260621 08:05:34.470043 11485 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 6.20, Last appended by leader: 20, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.470480 11140 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c reported cstate change: term changed from 6 to 8, leader changed from 059233fd6be44dd69800dba0818222c8 (127.10.87.194) to 011c8d128c6c486988112a63d930061c (127.10.87.195). New cstate: current_term: 8 leader_uuid: "011c8d128c6c486988112a63d930061c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:34.473389 11486 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 059233fd6be44dd69800dba0818222c8)
I20260621 08:05:34.473443 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 6 FOLLOWER]: Advancing to term 7
I20260621 08:05:34.473946 11486 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.474059 11486 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 7 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:34.474208 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:34.474213 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 20 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:34.474301 11320 raft_consensus.cc:2368] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 7. Current term is 8.
I20260621 08:05:34.474424 11209 leader_election.cc:400] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 7 election: Vote denied by peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681) with higher term. Message: Invalid argument: T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 7. Current term is 8.
I20260621 08:05:34.474455 11209 leader_election.cc:403] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260621 08:05:34.474510 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 7 FOLLOWER]: Advancing to term 8
I20260621 08:05:34.474982 11486 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681) with higher term. Message: Invalid argument: T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 7. Current term is 8.
I20260621 08:05:34.555953 11244 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 8 FOLLOWER]: Refusing update from remote peer 011c8d128c6c486988112a63d930061c: Log matching property violated. Preceding OpId in replica: term: 6 index: 20. Preceding OpId from leader: term: 8 index: 21. (index mismatch)
I20260621 08:05:34.556219 11485 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Connected to new peer: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260621 08:05:34.594336 11320 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Refusing update from remote peer 011c8d128c6c486988112a63d930061c: Log matching property violated. Preceding OpId in replica: term: 6 index: 20. Preceding OpId from leader: term: 8 index: 21. (index mismatch)
I20260621 08:05:34.594674 11485 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Connected to new peer: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260621 08:05:34.789361 11489 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 011c8d128c6c486988112a63d930061c)
I20260621 08:05:34.789456 11489 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:34.790078 11489 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.790225 11489 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 9 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:34.790434 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 9 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:34.790439 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 9 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:34.790663 11283 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 059233fd6be44dd69800dba0818222c8; no voters: 011c8d128c6c486988112a63d930061c, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:34.790758 11489 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260621 08:05:34.802680 11320 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 9 FOLLOWER]: Rejecting Update request from peer 011c8d128c6c486988112a63d930061c for earlier term 8. Current term is 9. Ops: []
I20260621 08:05:34.802888 11490 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: INVALID_TERM, Last received: 8.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260621 08:05:34.894125 11490 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 LEADER]: Stepping down as leader of term 8
I20260621 08:05:34.894227 11490 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 011c8d128c6c486988112a63d930061c, State: Running, Role: LEADER
I20260621 08:05:34.894340 11490 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 8.21, Last appended by leader: 21, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.894450 11490 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:34.931121 11489 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:34.931241 11489 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:34.931903 11489 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.932071 11489 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 10 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:34.932319 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 10 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:34.932341 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 10 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:34.932418 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:34.932979 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059233fd6be44dd69800dba0818222c8 in term 10.
I20260621 08:05:34.933146 11286 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8; no voters: 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:34.933259 11489 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 FOLLOWER]: Leader election won for term 10
I20260621 08:05:34.933393 11489 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 LEADER]: Becoming Leader. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:34.933449 11489 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 8.21, Last appended by leader: 21, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.933938 11140 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 reported cstate change: term changed from 8 to 10, leader changed from 011c8d128c6c486988112a63d930061c (127.10.87.195) to 059233fd6be44dd69800dba0818222c8 (127.10.87.194). New cstate: current_term: 10 leader_uuid: "059233fd6be44dd69800dba0818222c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:34.948601 11486 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 011c8d128c6c486988112a63d930061c)
I20260621 08:05:34.948684 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 8 FOLLOWER]: Advancing to term 9
I20260621 08:05:34.949299 11486 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:34.949450 11486 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 9 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:34.949664 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:34.949658 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 21 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:34.949769 11396 raft_consensus.cc:2368] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 9. Current term is 10.
I20260621 08:05:34.949957 11210 leader_election.cc:400] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 9 election: Vote denied by peer 011c8d128c6c486988112a63d930061c (127.10.87.195:40875) with higher term. Message: Invalid argument: T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 9. Current term is 10.
I20260621 08:05:34.950011 11210 leader_election.cc:403] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260621 08:05:34.950090 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 9 FOLLOWER]: Advancing to term 10
I20260621 08:05:34.950606 11486 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 011c8d128c6c486988112a63d930061c (127.10.87.195:40875) with higher term. Message: Invalid argument: T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 62dfd87f1926430f909686c71f3e07cd for earlier term 9. Current term is 10.
I20260621 08:05:35.010509 11244 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 10 FOLLOWER]: Refusing update from remote peer 059233fd6be44dd69800dba0818222c8: Log matching property violated. Preceding OpId in replica: term: 8 index: 21. Preceding OpId from leader: term: 10 index: 22. (index mismatch)
I20260621 08:05:35.010820 11489 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260621 08:05:35.054445 11396 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Refusing update from remote peer 059233fd6be44dd69800dba0818222c8: Log matching property violated. Preceding OpId in replica: term: 8 index: 21. Preceding OpId from leader: term: 10 index: 22. (index mismatch)
I20260621 08:05:35.054744 11489 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260621 08:05:35.112154 11486 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 059233fd6be44dd69800dba0818222c8)
I20260621 08:05:35.112236 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:35.112888 11486 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.113044 11486 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 11 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:35.113250 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:35.113231 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:35.113520 11210 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62dfd87f1926430f909686c71f3e07cd; no voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8
I20260621 08:05:35.113623 11486 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260621 08:05:35.119120 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.120345 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.122525 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.126708 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.134934 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.135778 11244 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Rejecting Update request from peer 059233fd6be44dd69800dba0818222c8 for earlier term 10. Current term is 11. Ops: []
I20260621 08:05:35.136015 11492 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 }, Status: INVALID_TERM, Last received: 10.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260621 08:05:35.151146 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.156005 11490 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 059233fd6be44dd69800dba0818222c8)
I20260621 08:05:35.156085 11490 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:35.156747 11490 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.156908 11490 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 11 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
I20260621 08:05:35.157078 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 11 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:35.157078 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "011c8d128c6c486988112a63d930061c" candidate_term: 11 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:35.157186 11244 raft_consensus.cc:2393] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 011c8d128c6c486988112a63d930061c in current term 11: Already voted for candidate 62dfd87f1926430f909686c71f3e07cd in this term.
I20260621 08:05:35.157320 11359 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 011c8d128c6c486988112a63d930061c; no voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:35.157420 11490 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260621 08:05:35.169066 11494 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 LEADER]: Stepping down as leader of term 10
I20260621 08:05:35.169165 11494 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:35.169247 11494 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 10.22, Last appended by leader: 22, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.169366 11494 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 10 FOLLOWER]: Advancing to term 11
I20260621 08:05:35.183408 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.218993 11486 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:35.219089 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:35.219731 11486 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.219913 11486 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 12 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:35.220124 11320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "059233fd6be44dd69800dba0818222c8"
I20260621 08:05:35.220185 11320 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:35.220161 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "62dfd87f1926430f909686c71f3e07cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 22 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:35.220288 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 11 FOLLOWER]: Advancing to term 12
I20260621 08:05:35.220790 11320 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 12.
I20260621 08:05:35.220898 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62dfd87f1926430f909686c71f3e07cd in term 12.
I20260621 08:05:35.221020 11209 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd; no voters:
I20260621 08:05:35.221143 11486 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 FOLLOWER]: Leader election won for term 12
I20260621 08:05:35.221252 11486 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 LEADER]: Becoming Leader. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:35.221309 11486 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 10.22, Last appended by leader: 22, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.221752 11140 catalog_manager.cc:5696] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd reported cstate change: term changed from 10 to 12, leader changed from 059233fd6be44dd69800dba0818222c8 (127.10.87.194) to 62dfd87f1926430f909686c71f3e07cd (127.10.87.193). New cstate: current_term: 12 leader_uuid: "62dfd87f1926430f909686c71f3e07cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:35.247617 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.317235 11320 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 12 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 22. Preceding OpId from leader: term: 12 index: 23. (index mismatch)
I20260621 08:05:35.317536 11486 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260621 08:05:35.318531 11396 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 12 FOLLOWER]: Refusing update from remote peer 62dfd87f1926430f909686c71f3e07cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 22. Preceding OpId from leader: term: 12 index: 23. (index mismatch)
I20260621 08:05:35.318846 11496 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260621 08:05:35.375870 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:35.376015 10591 log_reader.cc:385] T f485a1cfea0e43bb90ab24b5a453d01d: removed 1 log segments from log reader
I20260621 08:05:35.376045 10591 log.cc:1079] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Deleting log segment in path: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root/wals/f485a1cfea0e43bb90ab24b5a453d01d/wal-000000001 (ops 1-17)
I20260621 08:05:35.376515 10591 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260621 08:05:35.376577 10591 master.cc:562] Master@127.10.87.254:46841 shutting down...
I20260621 08:05:35.419324 11494 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 62dfd87f1926430f909686c71f3e07cd)
I20260621 08:05:35.419451 11494 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 12 FOLLOWER]: Advancing to term 13
I20260621 08:05:35.419946 10591 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:35.420024 10591 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:35.420053 10591 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88e53c38e29c4fbaaf9e9a8c502da537: stopping tablet replica
I20260621 08:05:35.420321 11494 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.420516 11494 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 13 election: Requested vote from peers 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
I20260621 08:05:35.420692 11244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 13 candidate_status { last_received { term: 12 index: 23 } } ignore_live_leader: false dest_uuid: "62dfd87f1926430f909686c71f3e07cd"
I20260621 08:05:35.420727 11396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f485a1cfea0e43bb90ab24b5a453d01d" candidate_uuid: "059233fd6be44dd69800dba0818222c8" candidate_term: 13 candidate_status { last_received { term: 12 index: 23 } } ignore_live_leader: false dest_uuid: "011c8d128c6c486988112a63d930061c"
I20260621 08:05:35.420794 11396 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 12 FOLLOWER]: Advancing to term 13
W20260621 08:05:35.421496 11270 heartbeater.cc:646] Failed to heartbeat to 127.10.87.254:46841 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.87.254:46841: connect: Connection refused (error 111)
I20260621 08:05:35.421504 11396 raft_consensus.cc:2468] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 059233fd6be44dd69800dba0818222c8 in term 13.
I20260621 08:05:35.421654 11395 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 13 FOLLOWER]: Rejecting Update request from peer 62dfd87f1926430f909686c71f3e07cd for earlier term 12. Current term is 13. Ops: []
I20260621 08:05:35.421836 11286 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8; no voters: 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:35.421917 11494 raft_consensus.cc:2804] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 FOLLOWER]: Leader election won for term 13
I20260621 08:05:35.421984 11494 raft_consensus.cc:697] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 LEADER]: Becoming Leader. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:35.422017 11486 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 12.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260621 08:05:35.422041 11494 consensus_queue.cc:237] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 12.23, Last appended by leader: 23, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.422107 11486 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 LEADER]: Stepping down as leader of term 12
I20260621 08:05:35.422140 11486 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Running, Role: LEADER
I20260621 08:05:35.422194 11486 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 12.23, Last appended by leader: 23, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.422257 11486 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 12 FOLLOWER]: Advancing to term 13
I20260621 08:05:35.433017 10591 master.cc:584] Master@127.10.87.254:46841 shutdown complete.
I20260621 08:05:35.434324 10591 tablet_server.cc:179] TabletServer@127.10.87.193:0 shutting down...
I20260621 08:05:35.481420 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:35.481631 10591 tablet_replica.cc:333] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: stopping tablet replica
I20260621 08:05:35.481688 10591 raft_consensus.cc:2243] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:35.481730 10591 raft_consensus.cc:2272] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:35.493791 10591 tablet_server.cc:196] TabletServer@127.10.87.193:0 shutdown complete.
I20260621 08:05:35.494776 10591 tablet_server.cc:179] TabletServer@127.10.87.194:0 shutting down...
W20260621 08:05:35.498611 11283 consensus_peers.cc:597] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 -> Peer 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405): Couldn't send request to peer 62dfd87f1926430f909686c71f3e07cd. Status: Network error: Client connection negotiation failed: client connection to 127.10.87.193:33405: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260621 08:05:35.509296 11395 raft_consensus.cc:1275] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 13 FOLLOWER]: Refusing update from remote peer 059233fd6be44dd69800dba0818222c8: Log matching property violated. Preceding OpId in replica: term: 12 index: 23. Preceding OpId from leader: term: 13 index: 24. (index mismatch)
I20260621 08:05:35.509524 11494 consensus_queue.cc:1048] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260621 08:05:35.610774 11490 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 059233fd6be44dd69800dba0818222c8)
I20260621 08:05:35.610875 11490 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:35.611585 11490 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.611738 11490 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 14 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
W20260621 08:05:35.612349 11361 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260621 08:05:35.612412 11359 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405): Network error: Client connection negotiation failed: client connection to 127.10.87.193:33405: connect: Connection refused (error 111)
I20260621 08:05:35.612468 11359 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 011c8d128c6c486988112a63d930061c; no voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:35.612548 11490 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260621 08:05:35.616572 11395 raft_consensus.cc:1240] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 14 FOLLOWER]: Rejecting Update request from peer 059233fd6be44dd69800dba0818222c8 for earlier term 13. Current term is 14. Ops: []
I20260621 08:05:35.616783 11494 consensus_queue.cc:1059] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 }, Status: INVALID_TERM, Last received: 13.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260621 08:05:35.616888 11494 raft_consensus.cc:3055] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 LEADER]: Stepping down as leader of term 13
I20260621 08:05:35.616923 11494 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 059233fd6be44dd69800dba0818222c8, State: Running, Role: LEADER
I20260621 08:05:35.616987 11494 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 13.24, Last appended by leader: 24, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.617064 11494 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:35.746778 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:35.746959 10591 tablet_replica.cc:333] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8: stopping tablet replica
I20260621 08:05:35.747036 10591 raft_consensus.cc:2243] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:35.747097 10591 raft_consensus.cc:2272] T f485a1cfea0e43bb90ab24b5a453d01d P 059233fd6be44dd69800dba0818222c8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:35.758945 11490 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:35.759042 11490 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 14 FOLLOWER]: Advancing to term 15
I20260621 08:05:35.759826 11490 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.760003 11490 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 15 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405)
W20260621 08:05:35.760527 11359 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 62dfd87f1926430f909686c71f3e07cd (127.10.87.193:33405): Network error: Client connection negotiation failed: client connection to 127.10.87.193:33405: connect: Connection refused (error 111)
I20260621 08:05:35.760528 10591 tablet_server.cc:196] TabletServer@127.10.87.194:0 shutdown complete.
W20260621 08:05:35.760639 11361 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681): Network error: Client connection negotiation failed: client connection to 127.10.87.194:46681: connect: Connection refused (error 111)
I20260621 08:05:35.760727 11361 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 011c8d128c6c486988112a63d930061c; no voters: 059233fd6be44dd69800dba0818222c8, 62dfd87f1926430f909686c71f3e07cd
I20260621 08:05:35.760802 11490 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260621 08:05:35.761449 10591 tablet_server.cc:179] TabletServer@127.10.87.195:0 shutting down...
I20260621 08:05:35.776525 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:35.776691 10591 tablet_replica.cc:333] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c: stopping tablet replica
I20260621 08:05:35.776738 10591 raft_consensus.cc:2243] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 15 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:35.776829 10591 raft_consensus.cc:2272] T f485a1cfea0e43bb90ab24b5a453d01d P 011c8d128c6c486988112a63d930061c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:35.788479 10591 tablet_server.cc:196] TabletServer@127.10.87.195:0 shutdown complete.
I20260621 08:05:35.789239 10591 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260621 08:05:35.789387 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
E20260621 08:05:35.789496 10591 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260621 08:05:35.790562 11503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:35.790630 11506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:35.790649 11504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:35.790824 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:35.790926 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:35.790959 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:35.790982 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029135790982 us; error 0 us; skew 500 ppm
I20260621 08:05:35.791566 10591 webserver.cc:533] Webserver started at http://127.10.87.193:34225/ using document root <none> and password file <none>
I20260621 08:05:35.791641 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:35.791674 10591 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260621 08:05:35.792299 10591 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:35.793609 11514 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:35.793720 10591 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:35.793773 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "62dfd87f1926430f909686c71f3e07cd"
format_stamp: "Formatted at 2026-06-21 08:05:32 on dist-test-slave-brsg"
I20260621 08:05:35.793829 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5314
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:35.802186 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:35.802345 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:35.802464 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:35.802763 11522 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260621 08:05:35.803491 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260621 08:05:35.803529 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:35.803560 10591 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260621 08:05:35.803961 10591 ts_tablet_manager.cc:616] Registered 1 tablets
I20260621 08:05:35.803990 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:35.804010 11522 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Bootstrap starting.
I20260621 08:05:35.805262 11522 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 08:05:35.805485 11522 tablet_bootstrap.cc:492] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Bootstrap complete.
I20260621 08:05:35.805576 11522 ts_tablet_manager.cc:1403] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260621 08:05:35.805691 11522 raft_consensus.cc:359] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.805750 11522 raft_consensus.cc:740] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62dfd87f1926430f909686c71f3e07cd, State: Initialized, Role: FOLLOWER
I20260621 08:05:35.805811 11522 consensus_queue.cc:260] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 23, Last appended: 12.23, Last appended by leader: 23, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.805974 11522 ts_tablet_manager.cc:1434] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260621 08:05:35.806921 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:33405
I20260621 08:05:35.808897 11581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:33405 every 8 connection(s)
W20260621 08:05:35.809628 11582 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260621 08:05:35.814899 10591 tablet_server.cc:179] TabletServer@127.10.87.193:33405 shutting down...
I20260621 08:05:35.916241 11560 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:35.916345 11560 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 13 FOLLOWER]: Advancing to term 14
I20260621 08:05:35.917079 11560 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:35.917289 11560 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 14 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
W20260621 08:05:35.917884 11518 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681): Network error: Client connection negotiation failed: client connection to 127.10.87.194:46681: connect: Connection refused (error 111)
W20260621 08:05:35.917972 11519 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 011c8d128c6c486988112a63d930061c (127.10.87.195:40875): Network error: Client connection negotiation failed: client connection to 127.10.87.195:40875: connect: Connection refused (error 111)
I20260621 08:05:35.918016 11519 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62dfd87f1926430f909686c71f3e07cd; no voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8
I20260621 08:05:35.918084 11560 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260621 08:05:36.049612 11560 raft_consensus.cc:493] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:36.049713 11560 raft_consensus.cc:3060] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 14 FOLLOWER]: Advancing to term 15
I20260621 08:05:36.050351 11560 raft_consensus.cc:515] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "059233fd6be44dd69800dba0818222c8" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 46681 } } peers { permanent_uuid: "62dfd87f1926430f909686c71f3e07cd" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33405 } } peers { permanent_uuid: "011c8d128c6c486988112a63d930061c" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 40875 } }
I20260621 08:05:36.050510 11560 leader_election.cc:290] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 15 election: Requested vote from peers 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681), 011c8d128c6c486988112a63d930061c (127.10.87.195:40875)
W20260621 08:05:36.051051 11519 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 011c8d128c6c486988112a63d930061c (127.10.87.195:40875): Network error: Client connection negotiation failed: client connection to 127.10.87.195:40875: connect: Connection refused (error 111)
W20260621 08:05:36.051126 11518 leader_election.cc:336] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 059233fd6be44dd69800dba0818222c8 (127.10.87.194:46681): Network error: Client connection negotiation failed: client connection to 127.10.87.194:46681: connect: Connection refused (error 111)
I20260621 08:05:36.051182 11518 leader_election.cc:304] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 62dfd87f1926430f909686c71f3e07cd; no voters: 011c8d128c6c486988112a63d930061c, 059233fd6be44dd69800dba0818222c8
I20260621 08:05:36.051285 11560 raft_consensus.cc:2749] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260621 08:05:36.059273 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:36.059404 10591 tablet_replica.cc:333] stopping tablet replica
I20260621 08:05:36.059473 10591 raft_consensus.cc:2243] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:36.059522 10591 raft_consensus.cc:2272] T f485a1cfea0e43bb90ab24b5a453d01d P 62dfd87f1926430f909686c71f3e07cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.071137 10591 tablet_server.cc:196] TabletServer@127.10.87.193:33405 shutdown complete.
[ OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (3173 ms)
[ RUN ] TimestampAdvancementITest.Kudu2463Test
I20260621 08:05:36.075457 10591 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.87.254:44171
I20260621 08:05:36.075599 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.076676 11589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.076730 11590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.076848 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:36.076889 11592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.077042 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.077078 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.077091 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136077092 us; error 0 us; skew 500 ppm
I20260621 08:05:36.077590 10591 webserver.cc:533] Webserver started at http://127.10.87.254:44093/ using document root <none> and password file <none>
I20260621 08:05:36.077654 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.077684 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:36.077726 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:36.077931 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/master-0-root/instance:
uuid: "47935f5e5fb243958a1c3f30d011d24b"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.078697 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.079087 11597 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.079209 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.079275 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/master-0-root
uuid: "47935f5e5fb243958a1c3f30d011d24b"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.079324 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.096055 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.096223 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.098537 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.254:44171
I20260621 08:05:36.099061 11650 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.254:44171 every 8 connection(s)
I20260621 08:05:36.099179 11651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:36.100174 11651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b: Bootstrap starting.
I20260621 08:05:36.100442 11651 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:36.100858 11651 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b: No bootstrap required, opened a new log
I20260621 08:05:36.100971 11651 raft_consensus.cc:359] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER }
I20260621 08:05:36.101018 11651 raft_consensus.cc:385] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:36.101035 11651 raft_consensus.cc:740] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47935f5e5fb243958a1c3f30d011d24b, State: Initialized, Role: FOLLOWER
I20260621 08:05:36.101089 11651 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER }
I20260621 08:05:36.101118 11651 raft_consensus.cc:399] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:36.101137 11651 raft_consensus.cc:493] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:36.101164 11651 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:36.101616 11651 raft_consensus.cc:515] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER }
I20260621 08:05:36.101670 11651 leader_election.cc:304] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47935f5e5fb243958a1c3f30d011d24b; no voters:
I20260621 08:05:36.101768 11651 leader_election.cc:290] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260621 08:05:36.101854 11654 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:36.101905 11651 sys_catalog.cc:565] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [sys.catalog]: configured and running, proceeding with master startup.
I20260621 08:05:36.101986 11654 raft_consensus.cc:697] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 1 LEADER]: Becoming Leader. State: Replica: 47935f5e5fb243958a1c3f30d011d24b, State: Running, Role: LEADER
I20260621 08:05:36.102039 11654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER }
I20260621 08:05:36.102222 11655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47935f5e5fb243958a1c3f30d011d24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER } }
I20260621 08:05:36.102296 11655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:36.102373 11656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47935f5e5fb243958a1c3f30d011d24b. Latest consensus state: current_term: 1 leader_uuid: "47935f5e5fb243958a1c3f30d011d24b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47935f5e5fb243958a1c3f30d011d24b" member_type: VOTER } }
I20260621 08:05:36.102524 11656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:36.102572 11662 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260621 08:05:36.102782 11662 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260621 08:05:36.103183 10591 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260621 08:05:36.103322 11662 catalog_manager.cc:1382] Generated new cluster ID: 4acab63515754b93b65771a76e98437e
I20260621 08:05:36.103356 11662 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260621 08:05:36.116776 11662 catalog_manager.cc:1405] Generated new certificate authority record
I20260621 08:05:36.117426 11662 catalog_manager.cc:1539] Loading token signing keys...
I20260621 08:05:36.125059 11662 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b: Generated new TSK 0
I20260621 08:05:36.125157 11662 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260621 08:05:36.134970 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.136256 11672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.136368 11673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.136363 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:36.136309 11675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.136536 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.136569 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.136580 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136136581 us; error 0 us; skew 500 ppm
I20260621 08:05:36.137140 10591 webserver.cc:533] Webserver started at http://127.10.87.193:39221/ using document root <none> and password file <none>
I20260621 08:05:36.137207 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.137243 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:36.137284 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:36.137516 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root/instance:
uuid: "5ebb9e191f234280a69510ad891d7b3d"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.138315 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:36.138796 11680 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.138912 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.138957 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "5ebb9e191f234280a69510ad891d7b3d"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.138998 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.144088 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.144255 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.144356 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:36.144493 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:36.144515 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.144538 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:36.144555 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.147020 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:35011
I20260621 08:05:36.147068 11743 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:35011 every 8 connection(s)
I20260621 08:05:36.147352 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.148442 11748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.148496 11749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.148658 11751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.148852 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:36.148983 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.149012 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.149029 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136149029 us; error 0 us; skew 500 ppm
I20260621 08:05:36.149567 10591 webserver.cc:533] Webserver started at http://127.10.87.194:40871/ using document root <none> and password file <none>
I20260621 08:05:36.149644 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.149691 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:36.149735 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:36.150015 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-1-root/instance:
uuid: "3a9280968d474e578a3a59b4de1d0112"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.150728 11744 heartbeater.cc:344] Connected to a master server at 127.10.87.254:44171
I20260621 08:05:36.150801 11744 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:36.150909 11744 heartbeater.cc:507] Master 127.10.87.254:44171 requested a full tablet report, sending...
I20260621 08:05:36.150964 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.151120 11615 ts_manager.cc:194] Registered new tserver with Master: 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193:35011)
I20260621 08:05:36.151471 11756 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.151598 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.151643 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-1-root
uuid: "3a9280968d474e578a3a59b4de1d0112"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.151687 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.151885 11615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42152
I20260621 08:05:36.155558 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.155740 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.155861 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:36.156028 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:36.156054 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.156073 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:36.156096 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.158946 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.194:33255
I20260621 08:05:36.158984 11820 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.194:33255 every 8 connection(s)
I20260621 08:05:36.159307 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.160446 11824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.160496 11825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.160642 11827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.160805 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:36.160908 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.160938 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.160955 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136160955 us; error 0 us; skew 500 ppm
I20260621 08:05:36.161557 10591 webserver.cc:533] Webserver started at http://127.10.87.195:34581/ using document root <none> and password file <none>
I20260621 08:05:36.161648 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.161692 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:36.161737 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:36.161971 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-2-root/instance:
uuid: "a5c177d4d0de4ee0953812c87b6cafe7"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.162232 11821 heartbeater.cc:344] Connected to a master server at 127.10.87.254:44171
I20260621 08:05:36.162293 11821 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:36.162381 11821 heartbeater.cc:507] Master 127.10.87.254:44171 requested a full tablet report, sending...
I20260621 08:05:36.162588 11615 ts_manager.cc:194] Registered new tserver with Master: 3a9280968d474e578a3a59b4de1d0112 (127.10.87.194:33255)
I20260621 08:05:36.162942 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:36.162997 11615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42158
I20260621 08:05:36.163435 11832 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.163556 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.163597 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-2-root
uuid: "a5c177d4d0de4ee0953812c87b6cafe7"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.163641 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.172703 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.172919 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.173066 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:36.173249 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:36.173274 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.173295 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:36.173306 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.176316 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.195:39817
I20260621 08:05:36.176409 11896 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.195:39817 every 8 connection(s)
I20260621 08:05:36.178996 11897 heartbeater.cc:344] Connected to a master server at 127.10.87.254:44171
I20260621 08:05:36.179062 11897 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:36.179153 11897 heartbeater.cc:507] Master 127.10.87.254:44171 requested a full tablet report, sending...
I20260621 08:05:36.179382 11615 ts_manager.cc:194] Registered new tserver with Master: a5c177d4d0de4ee0953812c87b6cafe7 (127.10.87.195:39817)
I20260621 08:05:36.179721 11615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42170
I20260621 08:05:36.179831 10591 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003372582s
I20260621 08:05:36.190420 11615 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42194:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260621 08:05:36.190573 11615 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260621 08:05:36.195104 11785 tablet_service.cc:1511] Processing CreateTablet for tablet 202ad4a4894040ff946c02f0cbd18b5b (DEFAULT_TABLE table=test-workload [id=13b409e6d1024f20a46e4058067db744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:36.195142 11860 tablet_service.cc:1511] Processing CreateTablet for tablet 202ad4a4894040ff946c02f0cbd18b5b (DEFAULT_TABLE table=test-workload [id=13b409e6d1024f20a46e4058067db744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:36.195268 11785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202ad4a4894040ff946c02f0cbd18b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:36.195312 11708 tablet_service.cc:1511] Processing CreateTablet for tablet 202ad4a4894040ff946c02f0cbd18b5b (DEFAULT_TABLE table=test-workload [id=13b409e6d1024f20a46e4058067db744]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:36.195269 11860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202ad4a4894040ff946c02f0cbd18b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:36.195433 11708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 202ad4a4894040ff946c02f0cbd18b5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:36.196625 11918 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Bootstrap starting.
I20260621 08:05:36.196830 11920 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: Bootstrap starting.
I20260621 08:05:36.197037 11918 tablet_bootstrap.cc:654] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:36.197223 11920 tablet_bootstrap.cc:654] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:36.197525 11919 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: Bootstrap starting.
I20260621 08:05:36.197579 11918 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: No bootstrap required, opened a new log
I20260621 08:05:36.197630 11918 ts_tablet_manager.cc:1403] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.197677 11920 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: No bootstrap required, opened a new log
I20260621 08:05:36.197724 11920 ts_tablet_manager.cc:1403] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.197793 11918 raft_consensus.cc:359] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.197863 11918 raft_consensus.cc:385] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:36.197881 11918 raft_consensus.cc:740] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ebb9e191f234280a69510ad891d7b3d, State: Initialized, Role: FOLLOWER
I20260621 08:05:36.197894 11920 raft_consensus.cc:359] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.197928 11919 tablet_bootstrap.cc:654] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:36.197966 11920 raft_consensus.cc:385] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:36.197948 11918 consensus_queue.cc:260] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.198041 11920 raft_consensus.cc:740] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a9280968d474e578a3a59b4de1d0112, State: Initialized, Role: FOLLOWER
I20260621 08:05:36.198102 11920 consensus_queue.cc:260] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.198187 11918 ts_tablet_manager.cc:1434] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.198256 11920 ts_tablet_manager.cc:1434] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.198266 11744 heartbeater.cc:499] Master 127.10.87.254:44171 was elected leader, sending a full tablet report...
I20260621 08:05:36.198392 11821 heartbeater.cc:499] Master 127.10.87.254:44171 was elected leader, sending a full tablet report...
I20260621 08:05:36.198544 11919 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: No bootstrap required, opened a new log
I20260621 08:05:36.198589 11919 ts_tablet_manager.cc:1403] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:36.198755 11919 raft_consensus.cc:359] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.198820 11919 raft_consensus.cc:385] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:36.198838 11919 raft_consensus.cc:740] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c177d4d0de4ee0953812c87b6cafe7, State: Initialized, Role: FOLLOWER
I20260621 08:05:36.198904 11919 consensus_queue.cc:260] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.199054 11919 ts_tablet_manager.cc:1434] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260621 08:05:36.199072 11897 heartbeater.cc:499] Master 127.10.87.254:44171 was elected leader, sending a full tablet report...
I20260621 08:05:36.224306 11924 raft_consensus.cc:493] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260621 08:05:36.224390 11924 raft_consensus.cc:515] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.224577 11924 leader_election.cc:290] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193:35011), a5c177d4d0de4ee0953812c87b6cafe7 (127.10.87.195:39817)
I20260621 08:05:36.227705 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202ad4a4894040ff946c02f0cbd18b5b" candidate_uuid: "3a9280968d474e578a3a59b4de1d0112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" is_pre_election: true
I20260621 08:05:36.227748 11718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202ad4a4894040ff946c02f0cbd18b5b" candidate_uuid: "3a9280968d474e578a3a59b4de1d0112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ebb9e191f234280a69510ad891d7b3d" is_pre_election: true
I20260621 08:05:36.227816 11871 raft_consensus.cc:2468] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9280968d474e578a3a59b4de1d0112 in term 0.
I20260621 08:05:36.227819 11718 raft_consensus.cc:2468] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a9280968d474e578a3a59b4de1d0112 in term 0.
I20260621 08:05:36.227984 11759 leader_election.cc:304] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9280968d474e578a3a59b4de1d0112, 5ebb9e191f234280a69510ad891d7b3d; no voters:
I20260621 08:05:36.228080 11924 raft_consensus.cc:2804] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260621 08:05:36.228118 11924 raft_consensus.cc:493] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260621 08:05:36.228133 11924 raft_consensus.cc:3060] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:36.228739 11924 raft_consensus.cc:515] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.228856 11924 leader_election.cc:290] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [CANDIDATE]: Term 1 election: Requested vote from peers 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193:35011), a5c177d4d0de4ee0953812c87b6cafe7 (127.10.87.195:39817)
I20260621 08:05:36.228971 11718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202ad4a4894040ff946c02f0cbd18b5b" candidate_uuid: "3a9280968d474e578a3a59b4de1d0112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ebb9e191f234280a69510ad891d7b3d"
I20260621 08:05:36.228984 11871 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "202ad4a4894040ff946c02f0cbd18b5b" candidate_uuid: "3a9280968d474e578a3a59b4de1d0112" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5c177d4d0de4ee0953812c87b6cafe7"
I20260621 08:05:36.229033 11718 raft_consensus.cc:3060] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:36.229046 11871 raft_consensus.cc:3060] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:36.229761 11871 raft_consensus.cc:2468] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9280968d474e578a3a59b4de1d0112 in term 1.
I20260621 08:05:36.229765 11718 raft_consensus.cc:2468] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a9280968d474e578a3a59b4de1d0112 in term 1.
I20260621 08:05:36.229908 11759 leader_election.cc:304] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a9280968d474e578a3a59b4de1d0112, 5ebb9e191f234280a69510ad891d7b3d; no voters:
I20260621 08:05:36.229992 11924 raft_consensus.cc:2804] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:36.230126 11924 raft_consensus.cc:697] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Becoming Leader. State: Replica: 3a9280968d474e578a3a59b4de1d0112, State: Running, Role: LEADER
I20260621 08:05:36.230175 11924 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.230645 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a9280968d474e578a3a59b4de1d0112 (127.10.87.194). New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: UNKNOWN } } }
I20260621 08:05:36.243395 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260621 08:05:36.243410 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260621 08:05:36.243659 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:36.243767 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260621 08:05:36.262534 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.262914 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260621 08:05:36.262914 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260621 08:05:36.263118 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260621 08:05:36.263207 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260621 08:05:36.263768 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.263875 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.264837 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.264860 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index -1 to 16, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.265009 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.265362 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
W20260621 08:05:36.265479 11613 catalog_manager.cc:5374] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 16: no extra replica candidate found for tablet 202ad4a4894040ff946c02f0cbd18b5b (table test-workload [id=13b409e6d1024f20a46e4058067db744]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260621 08:05:36.265648 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260621 08:05:36.265867 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260621 08:05:36.266003 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260621 08:05:36.266168 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.266309 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.266551 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.267129 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.267354 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 16 to 17, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.267491 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260621 08:05:36.267645 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:36.267938 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260621 08:05:36.268064 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.268172 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.268838 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260621 08:05:36.268990 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 17 to 18, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.269290 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.269351 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.269606 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260621 08:05:36.269790 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:36.270371 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.270437 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260621 08:05:36.270601 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260621 08:05:36.270896 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.271452 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.271579 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 18 to 19, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.271638 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.272297 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260621 08:05:36.272383 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260621 08:05:36.272554 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:36.272713 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260621 08:05:36.273258 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.273371 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.274196 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.274214 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 19 to 20, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.274359 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.274770 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260621 08:05:36.274928 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260621 08:05:36.275159 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260621 08:05:36.275375 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260621 08:05:36.275605 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.275702 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.276028 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.276526 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 20 to 21, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.277125 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.277460 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260621 08:05:36.277482 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260621 08:05:36.277616 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260621 08:05:36.277721 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260621 08:05:36.278075 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.278206 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.278251 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.278934 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 21 to 22, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.278941 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.279481 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260621 08:05:36.279481 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260621 08:05:36.279855 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260621 08:05:36.279935 11928 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260621 08:05:36.280368 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.280515 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.280561 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.281307 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 22 to 23, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.281463 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.281881 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260621 08:05:36.281925 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260621 08:05:36.282049 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260621 08:05:36.282138 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260621 08:05:36.282579 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.282691 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.282857 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.283587 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 23 to 24, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.283696 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.284039 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260621 08:05:36.284226 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260621 08:05:36.284256 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260621 08:05:36.284396 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260621 08:05:36.284721 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.284832 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.285115 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.285732 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.285719 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 24 to 25, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.286046 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260621 08:05:36.286305 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260621 08:05:36.286384 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260621 08:05:36.286486 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260621 08:05:36.286926 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.287070 11717 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.287901 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d reported cstate change: config changed from index 25 to 26, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.288388 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.288606 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.289043 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260621 08:05:36.289309 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260621 08:05:36.289326 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260621 08:05:36.289506 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260621 08:05:36.289819 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.289914 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.290733 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 26 to 27, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.290882 11717 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.291038 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.291435 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260621 08:05:36.291610 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260621 08:05:36.291749 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260621 08:05:36.291960 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260621 08:05:36.292181 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.292287 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.292995 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 27 to 28, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.293051 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.293467 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260621 08:05:36.293422 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260621 08:05:36.293659 11600 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 18: aborting the task: latest config opid_index 28; task opid_index 18
I20260621 08:05:36.293738 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260621 08:05:36.293802 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 27, Time since last communication: 0.000s
I20260621 08:05:36.294114 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.294327 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.294426 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.295121 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.295146 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 28 to 29, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.295457 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260621 08:05:36.295589 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260621 08:05:36.295631 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260621 08:05:36.295903 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 28, Time since last communication: 0.000s
I20260621 08:05:36.296039 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.296118 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.296132 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.296840 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.296905 11613 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 29 to 30, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.297214 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260621 08:05:36.297348 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 29, Time since last communication: 0.000s
I20260621 08:05:36.297492 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260621 08:05:36.297554 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.297683 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260621 08:05:36.298281 11936 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.298341 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.298564 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.299141 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 30 to 31, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.299235 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.299603 11718 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260621 08:05:36.299605 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260621 08:05:36.299774 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260621 08:05:36.299898 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260621 08:05:36.300328 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.300428 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.301088 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 31 to 32, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.301132 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.301167 11718 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.301424 11871 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260621 08:05:36.301658 11936 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260621 08:05:36.301990 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260621 08:05:36.302176 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260621 08:05:36.302304 11928 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.302451 11871 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.302711 11717 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.303169 11614 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 32 to 33, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.303287 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.303696 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260621 08:05:36.303838 11953 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260621 08:05:36.304168 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260621 08:05:36.304355 11953 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260621 08:05:36.304770 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.304874 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.305581 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 reported cstate change: config changed from index 33 to 34, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:36.305613 11717 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: NON_VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.305595 11795 consensus_queue.cc:237] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.307124 11717 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 LEARNER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260621 08:05:36.307231 11870 raft_consensus.cc:1275] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Refusing update from remote peer 3a9280968d474e578a3a59b4de1d0112: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260621 08:05:36.307395 11924 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260621 08:05:36.307456 11953 consensus_queue.cc:1048] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260621 08:05:36.307857 11924 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.307942 11870 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.308005 11717 raft_consensus.cc:2955] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.308593 11601 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 20: aborting the task: latest config opid_index 34; task opid_index 20
I20260621 08:05:36.308728 11615 catalog_manager.cc:5696] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 reported cstate change: config changed from index 34 to 35, 5ebb9e191f234280a69510ad891d7b3d (127.10.87.193) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3a9280968d474e578a3a59b4de1d0112" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } } }
I20260621 08:05:36.308843 10591 timestamp_advancement-itest.cc:267] GCing logs...
I20260621 08:05:36.308907 10591 log_reader.cc:385] T 202ad4a4894040ff946c02f0cbd18b5b: removed 1 log segments from log reader
I20260621 08:05:36.308936 10591 log.cc:1079] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Deleting log segment in path: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root/wals/202ad4a4894040ff946c02f0cbd18b5b/wal-000000001 (ops 1-15)
I20260621 08:05:36.309597 10591 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260621 08:05:36.309644 10591 master.cc:562] Master@127.10.87.254:44171 shutting down...
I20260621 08:05:36.310745 11601 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 22: aborting the task: latest config opid_index 35; task opid_index 22
I20260621 08:05:36.319303 11600 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 26: aborting the task: latest config opid_index 35; task opid_index 26
I20260621 08:05:36.320470 11598 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 16: aborting the task: latest config opid_index 35; task opid_index 16
I20260621 08:05:36.323661 11598 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 24: aborting the task: latest config opid_index 35; task opid_index 24
I20260621 08:05:36.325850 11598 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 30: aborting the task: latest config opid_index 35; task opid_index 30
I20260621 08:05:36.325928 11601 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 28: aborting the task: latest config opid_index 35; task opid_index 28
I20260621 08:05:36.339479 11600 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 32: aborting the task: latest config opid_index 35; task opid_index 32
I20260621 08:05:36.353686 11600 catalog_manager.cc:5243] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 202ad4a4894040ff946c02f0cbd18b5b with cas_config_opid_index 34: aborting the task: latest config opid_index 35; task opid_index 34
I20260621 08:05:36.358296 10591 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:36.358394 10591 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.358495 10591 tablet_replica.cc:333] T 00000000000000000000000000000000 P 47935f5e5fb243958a1c3f30d011d24b: stopping tablet replica
I20260621 08:05:36.360641 10591 master.cc:584] Master@127.10.87.254:44171 shutdown complete.
I20260621 08:05:36.361858 10591 tablet_server.cc:179] TabletServer@127.10.87.193:0 shutting down...
I20260621 08:05:36.397632 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:36.397845 10591 tablet_replica.cc:333] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: stopping tablet replica
I20260621 08:05:36.397894 10591 raft_consensus.cc:2243] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:36.397969 10591 raft_consensus.cc:2272] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.409978 10591 tablet_server.cc:196] TabletServer@127.10.87.193:0 shutdown complete.
I20260621 08:05:36.411012 10591 tablet_server.cc:179] TabletServer@127.10.87.194:0 shutting down...
I20260621 08:05:36.659744 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:36.659960 10591 tablet_replica.cc:333] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112: stopping tablet replica
I20260621 08:05:36.660022 10591 raft_consensus.cc:2243] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:36.660105 10591 raft_consensus.cc:2272] T 202ad4a4894040ff946c02f0cbd18b5b P 3a9280968d474e578a3a59b4de1d0112 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.672312 10591 tablet_server.cc:196] TabletServer@127.10.87.194:0 shutdown complete.
I20260621 08:05:36.673197 10591 tablet_server.cc:179] TabletServer@127.10.87.195:0 shutting down...
I20260621 08:05:36.676999 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:36.677289 10591 tablet_replica.cc:333] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7: stopping tablet replica
I20260621 08:05:36.677361 10591 raft_consensus.cc:2243] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:36.677466 10591 raft_consensus.cc:2272] T 202ad4a4894040ff946c02f0cbd18b5b P a5c177d4d0de4ee0953812c87b6cafe7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.689394 10591 tablet_server.cc:196] TabletServer@127.10.87.195:0 shutdown complete.
I20260621 08:05:36.690279 10591 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260621 08:05:36.690387 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.691439 11955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.691538 11954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.691560 11957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.691742 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:36.691859 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.691891 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.691913 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136691913 us; error 0 us; skew 500 ppm
I20260621 08:05:36.692396 10591 webserver.cc:533] Webserver started at http://127.10.87.193:39221/ using document root <none> and password file <none>
I20260621 08:05:36.692461 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.692497 10591 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260621 08:05:36.693101 10591 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.694238 11964 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.694339 10591 fs_manager.cc:730] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:36.694387 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "5ebb9e191f234280a69510ad891d7b3d"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.694437 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5268
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.706497 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.706647 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.706769 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:36.707545 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260621 08:05:36.707577 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:36.707986 10591 ts_tablet_manager.cc:616] Registered 1 tablets
I20260621 08:05:36.708014 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.708026 11971 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Bootstrap starting.
I20260621 08:05:36.709702 11971 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 08:05:36.709910 11971 tablet_bootstrap.cc:492] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Bootstrap complete.
I20260621 08:05:36.709998 11971 ts_tablet_manager.cc:1403] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260621 08:05:36.710110 11971 raft_consensus.cc:359] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.710168 11971 raft_consensus.cc:740] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ebb9e191f234280a69510ad891d7b3d, State: Initialized, Role: FOLLOWER
I20260621 08:05:36.710228 11971 consensus_queue.cc:260] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "3a9280968d474e578a3a59b4de1d0112" member_type: VOTER last_known_addr { host: "127.10.87.194" port: 33255 } } peers { permanent_uuid: "5ebb9e191f234280a69510ad891d7b3d" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 35011 } } peers { permanent_uuid: "a5c177d4d0de4ee0953812c87b6cafe7" member_type: VOTER last_known_addr { host: "127.10.87.195" port: 39817 } }
I20260621 08:05:36.710377 11971 ts_tablet_manager.cc:1434] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d: Time spent starting tablet: real 0.000s user 0.002s sys 0.000s
I20260621 08:05:36.710968 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:35011
I20260621 08:05:36.712700 12031 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:35011 every 8 connection(s)
W20260621 08:05:36.713369 12032 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260621 08:05:36.717499 11984 tablet_service.cc:3018] Rejecting scan request for tablet 202ad4a4894040ff946c02f0cbd18b5b: Uninitialized: clean time has not yet been initialized
I20260621 08:05:36.717727 10591 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260621 08:05:36.718024 10591 tablet_server.cc:179] TabletServer@127.10.87.193:35011 shutting down...
I20260621 08:05:36.963133 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:36.963389 10591 tablet_replica.cc:333] stopping tablet replica
I20260621 08:05:36.963460 10591 raft_consensus.cc:2243] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260621 08:05:36.963518 10591 raft_consensus.cc:2272] T 202ad4a4894040ff946c02f0cbd18b5b P 5ebb9e191f234280a69510ad891d7b3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:36.975126 10591 tablet_server.cc:196] TabletServer@127.10.87.193:35011 shutdown complete.
[ OK ] TimestampAdvancementITest.Kudu2463Test (903 ms)
[ RUN ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260621 08:05:36.979303 10591 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260621 08:05:36.979444 10591 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.87.254:45229
I20260621 08:05:36.979574 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:36.980652 12039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.980790 12037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:36.980798 12036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:36.980988 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:36.981115 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:36.981146 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:36.981171 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029136981171 us; error 0 us; skew 500 ppm
I20260621 08:05:36.981662 10591 webserver.cc:533] Webserver started at http://127.10.87.254:35305/ using document root <none> and password file <none>
I20260621 08:05:36.981731 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:36.981779 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:36.981850 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:36.982088 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root/instance:
uuid: "22e18d1a548b4f84adb3caf759f54f3f"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.982870 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:36.983348 12044 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.983481 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:36.983529 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
uuid: "22e18d1a548b4f84adb3caf759f54f3f"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:36.983577 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:36.996371 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:36.996528 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:36.998847 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.254:45229
I20260621 08:05:36.999353 12096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.254:45229 every 8 connection(s)
I20260621 08:05:36.999471 12097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:37.000404 12097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Bootstrap starting.
I20260621 08:05:37.000674 12097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:37.001215 12097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: No bootstrap required, opened a new log
I20260621 08:05:37.001334 12097 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.001394 12097 raft_consensus.cc:385] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:37.001408 12097 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e18d1a548b4f84adb3caf759f54f3f, State: Initialized, Role: FOLLOWER
I20260621 08:05:37.001448 12097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.001483 12097 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:37.001505 12097 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:37.001528 12097 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:37.002048 12097 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.002103 12097 leader_election.cc:304] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e18d1a548b4f84adb3caf759f54f3f; no voters:
I20260621 08:05:37.002197 12097 leader_election.cc:290] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260621 08:05:37.002301 12100 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:37.002373 12097 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: configured and running, proceeding with master startup.
I20260621 08:05:37.002437 12100 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 LEADER]: Becoming Leader. State: Replica: 22e18d1a548b4f84adb3caf759f54f3f, State: Running, Role: LEADER
I20260621 08:05:37.002490 12100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.002694 12101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e18d1a548b4f84adb3caf759f54f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER } }
I20260621 08:05:37.002753 12102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e18d1a548b4f84adb3caf759f54f3f. Latest consensus state: current_term: 1 leader_uuid: "22e18d1a548b4f84adb3caf759f54f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER } }
I20260621 08:05:37.002823 12101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:37.002841 12102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:37.003093 12110 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260621 08:05:37.003253 12110 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260621 08:05:37.003670 10591 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260621 08:05:37.003799 12110 catalog_manager.cc:1382] Generated new cluster ID: 9dcae5cbfbf64dc5b6fba89c413c0123
I20260621 08:05:37.003829 12110 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260621 08:05:37.010718 12110 catalog_manager.cc:1405] Generated new certificate authority record
I20260621 08:05:37.011154 12110 catalog_manager.cc:1539] Loading token signing keys...
I20260621 08:05:37.014415 12110 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Generated new TSK 0
I20260621 08:05:37.014492 12110 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260621 08:05:37.019335 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:37.020560 12119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.020735 12118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.020754 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:37.020794 12121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.020991 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:37.021026 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:37.021039 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029137021038 us; error 0 us; skew 500 ppm
I20260621 08:05:37.021538 10591 webserver.cc:533] Webserver started at http://127.10.87.193:40825/ using document root <none> and password file <none>
I20260621 08:05:37.021602 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:37.021633 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:37.021664 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:37.021884 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root/instance:
uuid: "1ceb06930e2145f4b737a36b6a393c4b"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.022651 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260621 08:05:37.023034 12126 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.023150 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.023200 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "1ceb06930e2145f4b737a36b6a393c4b"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.023268 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:37.037588 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:37.037770 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:37.037909 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:37.038094 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:37.038120 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.038148 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:37.038180 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.040860 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:33989
I20260621 08:05:37.040899 12190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:33989 every 8 connection(s)
I20260621 08:05:37.044154 12191 heartbeater.cc:344] Connected to a master server at 127.10.87.254:45229
I20260621 08:05:37.044222 12191 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:37.044323 12191 heartbeater.cc:507] Master 127.10.87.254:45229 requested a full tablet report, sending...
I20260621 08:05:37.044569 12061 ts_manager.cc:194] Registered new tserver with Master: 1ceb06930e2145f4b737a36b6a393c4b (127.10.87.193:33989)
I20260621 08:05:37.045118 12061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46070
I20260621 08:05:37.045455 10591 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004427435s
I20260621 08:05:37.055872 12061 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46098:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260621 08:05:37.059531 12155 tablet_service.cc:1511] Processing CreateTablet for tablet 86be1b448329479688607c6cc7950e51 (DEFAULT_TABLE table=test-workload [id=4c07a8bdb19842e2a995696d08a81927]), partition=RANGE (key) PARTITION UNBOUNDED
I20260621 08:05:37.059639 12155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86be1b448329479688607c6cc7950e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260621 08:05:37.060755 12209 tablet_bootstrap.cc:492] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Bootstrap starting.
I20260621 08:05:37.061060 12209 tablet_bootstrap.cc:654] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Neither blocks nor log segments found. Creating new log.
I20260621 08:05:37.061487 12209 tablet_bootstrap.cc:492] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: No bootstrap required, opened a new log
I20260621 08:05:37.061524 12209 ts_tablet_manager.cc:1403] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:37.061620 12209 raft_consensus.cc:359] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.061663 12209 raft_consensus.cc:385] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260621 08:05:37.061679 12209 raft_consensus.cc:740] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ceb06930e2145f4b737a36b6a393c4b, State: Initialized, Role: FOLLOWER
I20260621 08:05:37.061729 12209 consensus_queue.cc:260] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.061769 12209 raft_consensus.cc:399] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:37.061784 12209 raft_consensus.cc:493] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:37.061808 12209 raft_consensus.cc:3060] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 0 FOLLOWER]: Advancing to term 1
I20260621 08:05:37.062319 12209 raft_consensus.cc:515] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.062376 12209 leader_election.cc:304] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ceb06930e2145f4b737a36b6a393c4b; no voters:
I20260621 08:05:37.062479 12209 leader_election.cc:290] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260621 08:05:37.062528 12211 raft_consensus.cc:2804] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Leader election won for term 1
I20260621 08:05:37.062620 12191 heartbeater.cc:499] Master 127.10.87.254:45229 was elected leader, sending a full tablet report...
I20260621 08:05:37.062650 12211 raft_consensus.cc:697] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 LEADER]: Becoming Leader. State: Replica: 1ceb06930e2145f4b737a36b6a393c4b, State: Running, Role: LEADER
I20260621 08:05:37.062681 12209 ts_tablet_manager.cc:1434] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:37.062697 12211 consensus_queue.cc:237] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.063088 12061 catalog_manager.cc:5696] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ceb06930e2145f4b737a36b6a393c4b (127.10.87.193). New cstate: current_term: 1 leader_uuid: "1ceb06930e2145f4b737a36b6a393c4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:37.065618 10591 tablet_server.cc:179] TabletServer@127.10.87.193:0 shutting down...
I20260621 08:05:37.067803 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:37.067936 10591 tablet_replica.cc:333] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: stopping tablet replica
I20260621 08:05:37.067988 10591 raft_consensus.cc:2243] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:37.068027 10591 raft_consensus.cc:2272] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:37.079502 10591 tablet_server.cc:196] TabletServer@127.10.87.193:0 shutdown complete.
I20260621 08:05:37.080380 10591 master.cc:562] Master@127.10.87.254:45229 shutting down...
I20260621 08:05:37.082464 10591 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 LEADER]: Raft consensus shutting down.
I20260621 08:05:37.082521 10591 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:37.082608 10591 tablet_replica.cc:333] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: stopping tablet replica
I20260621 08:05:37.094475 10591 master.cc:584] Master@127.10.87.254:45229 shutdown complete.
I20260621 08:05:37.096139 10591 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260621 08:05:37.096302 10591 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.10.87.254:46065
I20260621 08:05:37.096431 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:37.097652 12218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.097692 12216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.097723 12215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.097872 10591 server_base.cc:1061] running on GCE node
I20260621 08:05:37.097967 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:37.097990 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:37.098002 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029137098003 us; error 0 us; skew 500 ppm
I20260621 08:05:37.098512 10591 webserver.cc:533] Webserver started at http://127.10.87.254:33697/ using document root <none> and password file <none>
I20260621 08:05:37.098579 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:37.098611 10591 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260621 08:05:37.099085 10591 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.099525 12223 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.099629 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.099668 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
uuid: "22e18d1a548b4f84adb3caf759f54f3f"
format_stamp: "Formatted at 2026-06-21 08:05:36 on dist-test-slave-brsg"
I20260621 08:05:37.099726 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:37.106252 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:37.106410 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:37.108768 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.254:46065
I20260621 08:05:37.109588 12275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.254:46065 every 8 connection(s)
I20260621 08:05:37.110109 12276 sys_catalog.cc:263] Verifying existing consensus state
I20260621 08:05:37.110417 12276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Bootstrap starting.
I20260621 08:05:37.112004 12276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 08:05:37.112205 12276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Bootstrap complete.
I20260621 08:05:37.112411 12276 raft_consensus.cc:359] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.112481 12276 raft_consensus.cc:740] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e18d1a548b4f84adb3caf759f54f3f, State: Initialized, Role: FOLLOWER
I20260621 08:05:37.112522 12276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.112555 12276 raft_consensus.cc:399] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:37.112576 12276 raft_consensus.cc:493] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:37.112598 12276 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:37.113137 12276 raft_consensus.cc:515] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.113197 12276 leader_election.cc:304] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e18d1a548b4f84adb3caf759f54f3f; no voters:
I20260621 08:05:37.113299 12276 leader_election.cc:290] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260621 08:05:37.113341 12279 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 2 FOLLOWER]: Leader election won for term 2
I20260621 08:05:37.113448 12279 raft_consensus.cc:697] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 2 LEADER]: Becoming Leader. State: Replica: 22e18d1a548b4f84adb3caf759f54f3f, State: Running, Role: LEADER
I20260621 08:05:37.113453 12276 sys_catalog.cc:565] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: configured and running, proceeding with master startup.
I20260621 08:05:37.113509 12279 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER }
I20260621 08:05:37.113724 12280 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "22e18d1a548b4f84adb3caf759f54f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER } }
I20260621 08:05:37.113731 12281 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e18d1a548b4f84adb3caf759f54f3f. Latest consensus state: current_term: 2 leader_uuid: "22e18d1a548b4f84adb3caf759f54f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e18d1a548b4f84adb3caf759f54f3f" member_type: VOTER } }
I20260621 08:05:37.113811 12280 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:37.113817 12281 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [sys.catalog]: This master's current role is: LEADER
I20260621 08:05:37.114679 10591 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260621 08:05:37.114856 12295 catalog_manager.cc:1294] Loaded cluster ID: 9dcae5cbfbf64dc5b6fba89c413c0123
I20260621 08:05:37.114898 12295 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: loading cluster ID for follower catalog manager: success
I20260621 08:05:37.115679 12295 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: acquiring CA information for follower catalog manager: success
I20260621 08:05:37.115871 12295 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260621 08:05:37.115942 12284 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
I20260621 08:05:37.116113 12284 catalog_manager.cc:679] Loaded metadata for table test-workload [id=4c07a8bdb19842e2a995696d08a81927]
I20260621 08:05:37.116200 12284 tablet_loader.cc:96] loaded metadata for tablet 86be1b448329479688607c6cc7950e51 (table test-workload [id=4c07a8bdb19842e2a995696d08a81927])
I20260621 08:05:37.116228 12284 catalog_manager.cc:1519] Initializing Kudu cluster ID...
I20260621 08:05:37.116263 12284 catalog_manager.cc:1294] Loaded cluster ID: 9dcae5cbfbf64dc5b6fba89c413c0123
I20260621 08:05:37.116290 12284 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
I20260621 08:05:37.116401 12284 catalog_manager.cc:1539] Loading token signing keys...
I20260621 08:05:37.116447 12284 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f: Loaded TSK: 0
I20260621 08:05:37.116508 12284 catalog_manager.cc:1549] Initializing in-progress tserver states...
I20260621 08:05:37.118086 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:37.119247 12296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.119371 12299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.119376 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:37.119478 12297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.119611 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:37.119645 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:37.119657 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029137119658 us; error 0 us; skew 500 ppm
I20260621 08:05:37.120220 10591 webserver.cc:533] Webserver started at http://127.10.87.193:43703/ using document root <none> and password file <none>
I20260621 08:05:37.120293 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:37.120317 10591 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260621 08:05:37.120896 10591 fs_manager.cc:714] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260621 08:05:37.121296 12304 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.121419 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.121467 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
uuid: "1ceb06930e2145f4b737a36b6a393c4b"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.121520 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:37.140966 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:37.141168 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:37.141316 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:37.141575 12312 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260621 08:05:37.142174 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260621 08:05:37.142226 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260621 08:05:37.142251 10591 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260621 08:05:37.142642 10591 ts_tablet_manager.cc:616] Registered 1 tablets
I20260621 08:05:37.142671 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.142683 12312 tablet_bootstrap.cc:492] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Bootstrap starting.
I20260621 08:05:37.143893 12312 tablet_bootstrap.cc:492] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260621 08:05:37.144147 12312 tablet_bootstrap.cc:492] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Bootstrap complete.
I20260621 08:05:37.144246 12312 ts_tablet_manager.cc:1403] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260621 08:05:37.144404 12312 raft_consensus.cc:359] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.144476 12312 raft_consensus.cc:740] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ceb06930e2145f4b737a36b6a393c4b, State: Initialized, Role: FOLLOWER
I20260621 08:05:37.144529 12312 consensus_queue.cc:260] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.144574 12312 raft_consensus.cc:399] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260621 08:05:37.144603 12312 raft_consensus.cc:493] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260621 08:05:37.144629 12312 raft_consensus.cc:3060] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 1 FOLLOWER]: Advancing to term 2
I20260621 08:05:37.145411 12312 raft_consensus.cc:515] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.145486 12312 leader_election.cc:304] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ceb06930e2145f4b737a36b6a393c4b; no voters:
I20260621 08:05:37.145589 12312 leader_election.cc:290] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260621 08:05:37.145628 12366 raft_consensus.cc:2804] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 2 FOLLOWER]: Leader election won for term 2
I20260621 08:05:37.145711 12312 ts_tablet_manager.cc:1434] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260621 08:05:37.145751 12366 raft_consensus.cc:697] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 2 LEADER]: Becoming Leader. State: Replica: 1ceb06930e2145f4b737a36b6a393c4b, State: Running, Role: LEADER
I20260621 08:05:37.145812 12366 consensus_queue.cc:237] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } }
I20260621 08:05:37.146041 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.193:37007
I20260621 08:05:37.146075 12374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.193:37007 every 8 connection(s)
I20260621 08:05:37.146375 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:37.147498 12380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.147537 12383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.147643 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:37.147720 12381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.147876 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:37.147908 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:37.147924 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029137147924 us; error 0 us; skew 500 ppm
I20260621 08:05:37.148530 10591 webserver.cc:533] Webserver started at http://127.10.87.194:42685/ using document root <none> and password file <none>
I20260621 08:05:37.148612 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:37.148653 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:37.148706 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:37.148968 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-1-root/instance:
uuid: "3b36c60d750846c2bb97b23ebdee1131"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.149860 12376 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46065
I20260621 08:05:37.149924 12376 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:37.149991 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:37.150030 12376 heartbeater.cc:507] Master 127.10.87.254:46065 requested a full tablet report, sending...
I20260621 08:05:37.150270 12240 ts_manager.cc:194] Registered new tserver with Master: 1ceb06930e2145f4b737a36b6a393c4b (127.10.87.193:37007)
I20260621 08:05:37.150331 12240 catalog_manager.cc:5696] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "1ceb06930e2145f4b737a36b6a393c4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ceb06930e2145f4b737a36b6a393c4b" member_type: VOTER last_known_addr { host: "127.10.87.193" port: 33989 } health_report { overall_health: HEALTHY } } }
I20260621 08:05:37.150501 12388 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.150614 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.150661 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-1-root
uuid: "3b36c60d750846c2bb97b23ebdee1131"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.150698 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:37.151507 12240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36922
I20260621 08:05:37.151844 12376 heartbeater.cc:499] Master 127.10.87.254:46065 was elected leader, sending a full tablet report...
I20260621 08:05:37.162364 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:37.162560 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:37.162701 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:37.162902 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:37.162930 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.162957 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:37.162983 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.165953 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.194:38951
I20260621 08:05:37.166004 12453 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.194:38951 every 8 connection(s)
I20260621 08:05:37.166301 10591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260621 08:05:37.167466 12457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260621 08:05:37.167570 12460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.167768 10591 server_base.cc:1061] running on GCE node
W20260621 08:05:37.167872 12458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260621 08:05:37.168136 10591 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260621 08:05:37.168171 10591 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260621 08:05:37.168183 10591 hybrid_clock.cc:648] HybridClock initialized: now 1782029137168184 us; error 0 us; skew 500 ppm
I20260621 08:05:37.168756 10591 webserver.cc:533] Webserver started at http://127.10.87.195:41769/ using document root <none> and password file <none>
I20260621 08:05:37.168838 10591 fs_manager.cc:362] Metadata directory not provided
I20260621 08:05:37.168886 10591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260621 08:05:37.168933 10591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260621 08:05:37.169209 12454 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46065
I20260621 08:05:37.169231 10591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-2-root/instance:
uuid: "88b21f97b1cf48019796cd498dbb0bef"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.169281 12454 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:37.169385 12454 heartbeater.cc:507] Master 127.10.87.254:46065 requested a full tablet report, sending...
I20260621 08:05:37.169588 12240 ts_manager.cc:194] Registered new tserver with Master: 3b36c60d750846c2bb97b23ebdee1131 (127.10.87.194:38951)
I20260621 08:05:37.169922 12240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36934
I20260621 08:05:37.170172 10591 fs_manager.cc:696] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260621 08:05:37.170639 12465 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.170737 10591 fs_manager.cc:730] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.170782 10591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-2-root
uuid: "88b21f97b1cf48019796cd498dbb0bef"
format_stamp: "Formatted at 2026-06-21 08:05:37 on dist-test-slave-brsg"
I20260621 08:05:37.170825 10591 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskqNL6nV/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1782029100336519-10591-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260621 08:05:37.181329 10591 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260621 08:05:37.181525 10591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260621 08:05:37.181651 10591 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260621 08:05:37.181813 10591 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260621 08:05:37.181840 10591 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.181865 10591 ts_tablet_manager.cc:616] Registered 0 tablets
I20260621 08:05:37.181890 10591 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260621 08:05:37.184986 10591 rpc_server.cc:307] RPC server started. Bound to: 127.10.87.195:33671
I20260621 08:05:37.185036 12528 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.87.195:33671 every 8 connection(s)
I20260621 08:05:37.187602 12529 heartbeater.cc:344] Connected to a master server at 127.10.87.254:46065
I20260621 08:05:37.187657 12529 heartbeater.cc:461] Registering TS with master...
I20260621 08:05:37.187729 12529 heartbeater.cc:507] Master 127.10.87.254:46065 requested a full tablet report, sending...
I20260621 08:05:37.187954 12240 ts_manager.cc:194] Registered new tserver with Master: 88b21f97b1cf48019796cd498dbb0bef (127.10.87.195:33671)
I20260621 08:05:37.188284 12240 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36938
I20260621 08:05:37.188405 10591 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.003261323s
I20260621 08:05:37.198877 10591 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260621 08:05:37.198943 10591 tablet_server.cc:179] TabletServer@127.10.87.193:0 shutting down...
I20260621 08:05:37.201009 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:37.201205 10591 tablet_replica.cc:333] stopping tablet replica
I20260621 08:05:37.201267 10591 raft_consensus.cc:2243] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 2 LEADER]: Raft consensus shutting down.
I20260621 08:05:37.201323 10591 raft_consensus.cc:2272] T 86be1b448329479688607c6cc7950e51 P 1ceb06930e2145f4b737a36b6a393c4b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:37.213279 10591 tablet_server.cc:196] TabletServer@127.10.87.193:0 shutdown complete.
I20260621 08:05:37.214398 10591 tablet_server.cc:179] TabletServer@127.10.87.194:0 shutting down...
I20260621 08:05:37.216495 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:37.227845 10591 tablet_server.cc:196] TabletServer@127.10.87.194:0 shutdown complete.
I20260621 08:05:37.228618 10591 tablet_server.cc:179] TabletServer@127.10.87.195:0 shutting down...
I20260621 08:05:37.230695 10591 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260621 08:05:37.242012 10591 tablet_server.cc:196] TabletServer@127.10.87.195:0 shutdown complete.
I20260621 08:05:37.242792 10591 master.cc:562] Master@127.10.87.254:46065 shutting down...
I20260621 08:05:37.244872 10591 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 2 LEADER]: Raft consensus shutting down.
I20260621 08:05:37.244935 10591 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 22e18d1a548b4f84adb3caf759f54f3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260621 08:05:37.245009 10591 tablet_replica.cc:333] stopping tablet replica
I20260621 08:05:37.246495 10591 master.cc:584] Master@127.10.87.254:46065 shutdown complete.
[ OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (270 ms)
[----------] 4 tests from TimestampAdvancementITest (36909 ms total)
[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (36909 ms total)
[ PASSED ] 3 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
1 FAILED TEST
I20260621 08:05:37.250176 10591 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/master/catalog_manager.cc:5374: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260621 08:05:37.250212 10591 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 11 messages since previous log ~1 seconds ago
I20260621 08:05:37.250233 10591 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 14 messages since previous log ~4 seconds ago
I20260621 08:05:37.250288 10591 logging.cc:436] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 566 messages since previous log ~36 seconds ago