TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/timestamp_advancement-itest.cc:261: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/timestamp_advancement-itest.cc:326: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20260620 23:03:49.764261 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:49.820842 32022 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:49.820943 32022 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.821753 32022 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.821964 32022 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.822217 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
W20260620 23:03:49.822417 31691 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 23:03:49.822939 31691 leader_election.cc:334] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: RPC error from VoteRequest() call to peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 23:03:49.823014 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:49.823143 32022 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260620 23:03:49.859777 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 162. Current term is 163. Ops: []
I20260620 23:03:49.860090 32023 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260620 23:03:49.860255 32023 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 LEADER]: Stepping down as leader of term 162
I20260620 23:03:49.860320 32023 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:49.860396 32023 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 162.132, Last appended by leader: 132, Current term: 162, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.860489 32023 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.911717 32024 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:49.911834 32024 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.912667 32024 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.912863 32024 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 163 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:49.913131 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:49.913141 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:49.913302 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 163: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:49.913348 31802 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for term 163 because replica has last-logged OpId of term: 162 index: 132, which is greater than that of the candidate, which has last-logged OpId of term: 161 index: 131.
I20260620 23:03:49.913550 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:49.913669 32024 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260620 23:03:49.927671 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.927852 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: stopping tablet replica
I20260620 23:03:49.927983 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.928049 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:49.940958 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:49.942476 31518 tablet_server.cc:178] TabletServer@127.30.199.130:0 shutting down...
I20260620 23:03:49.978211 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.978439 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: stopping tablet replica
I20260620 23:03:49.978504 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.978579 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:49.990785 31518 tablet_server.cc:194] TabletServer@127.30.199.130:0 shutdown complete.
I20260620 23:03:49.991809 31518 tablet_server.cc:178] TabletServer@127.30.199.131:0 shutting down...
I20260620 23:03:49.996701 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.996820 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: stopping tablet replica
I20260620 23:03:49.996882 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.996940 31518 pending_rounds.cc:62] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Trying to abort 1 pending ops.
I20260620 23:03:49.996953 31518 pending_rounds.cc:68] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting op as it isn't in flight: id { term: 162 index: 132 } timestamp: 7299058195507621888 op_type: NO_OP noop_request { }
I20260620 23:03:49.997043 31518 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 23:03:49.997068 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:50.009236 31518 tablet_server.cc:194] TabletServer@127.30.199.131:0 shutdown complete.
I20260620 23:03:50.010416 31518 master.cc:537] Master@127.30.199.190:39689 shutting down...
I20260620 23:03:50.111253 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:50.111368 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:50.111397 31518 tablet_replica.cc:330] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: stopping tablet replica
I20260620 23:03:50.123991 31518 master.cc:552] Master@127.30.199.190:39689 shutdown complete.
I20260620 23:03:50.126276 31518 test_util.cc:175] -----------------------------------------------
I20260620 23:03:50.126379 31518 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0

[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN      ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260620 23:03:17.568874 31518 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.199.190:39689
I20260620 23:03:17.569367 31518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260620 23:03:17.569661 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:17.574889 31523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.575141 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:17.574894 31524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:17.574937 31526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.575490 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:17.575544 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:17.575569 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996597575569 us; error 0 us; skew 500 ppm
I20260620 23:03:17.577019 31518 webserver.cc:460] Webserver started at http://127.30.199.190:39479/ using document root <none> and password file <none>
I20260620 23:03:17.577224 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:17.577284 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:17.577371 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:17.578647 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/master-0-root/instance:
uuid: "fdb3340f5d3f42e589d7f0ed66f6d555"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.580224 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260620 23:03:17.580931 31531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.581108 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:17.581183 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/master-0-root
uuid: "fdb3340f5d3f42e589d7f0ed66f6d555"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.581238 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:17.594700 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:17.594992 31518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260620 23:03:17.595090 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:17.595431 31537 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260620 23:03:17.599275 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.190:39689
I20260620 23:03:17.599359 31583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.190:39689 every 8 connection(s)
I20260620 23:03:17.600256 31584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:17.603358 31584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: Bootstrap starting.
I20260620 23:03:17.604250 31584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:17.604511 31584 log.cc:824] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: Log is configured to *not* fsync() on all Append() calls
I20260620 23:03:17.605087 31584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: No bootstrap required, opened a new log
I20260620 23:03:17.606588 31584 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER }
I20260620 23:03:17.606734 31584 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:17.606760 31584 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb3340f5d3f42e589d7f0ed66f6d555, State: Initialized, Role: FOLLOWER
I20260620 23:03:17.606881 31584 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER }
I20260620 23:03:17.606935 31584 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:17.606956 31584 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:17.606989 31584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:17.607465 31584 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER }
I20260620 23:03:17.607553 31584 leader_election.cc:302] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb3340f5d3f42e589d7f0ed66f6d555; no voters: 
I20260620 23:03:17.607692 31584 leader_election.cc:288] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 23:03:17.607736 31587 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:17.607895 31587 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 LEADER]: Becoming Leader. State: Replica: fdb3340f5d3f42e589d7f0ed66f6d555, State: Running, Role: LEADER
I20260620 23:03:17.608032 31587 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER }
I20260620 23:03:17.608063 31584 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 23:03:17.608533 31589 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb3340f5d3f42e589d7f0ed66f6d555. Latest consensus state: current_term: 1 leader_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER } }
I20260620 23:03:17.608530 31588 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb3340f5d3f42e589d7f0ed66f6d555" member_type: VOTER } }
I20260620 23:03:17.608670 31589 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:17.608817 31588 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:17.609020 31596 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 23:03:17.609606 31596 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 23:03:17.609750 31518 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 23:03:17.611490 31596 catalog_manager.cc:1347] Generated new cluster ID: 392824be1fdf43a5b495ab7e6b1b17d5
I20260620 23:03:17.611547 31596 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 23:03:17.632000 31596 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 23:03:17.632685 31596 catalog_manager.cc:1504] Loading token signing keys...
I20260620 23:03:17.638638 31596 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: Generated new TSK 0
I20260620 23:03:17.638893 31596 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 23:03:17.641747 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:17.643541 31606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.643669 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:17.643656 31607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:17.643800 31609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.643983 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:17.644022 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:17.644042 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996597644042 us; error 0 us; skew 500 ppm
I20260620 23:03:17.644856 31518 webserver.cc:460] Webserver started at http://127.30.199.129:44071/ using document root <none> and password file <none>
I20260620 23:03:17.644956 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:17.645007 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:17.645056 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:17.645416 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-0-root/instance:
uuid: "e958ff05bd794a0496045351b3a629d9"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.646692 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260620 23:03:17.647306 31614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.647450 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:17.647505 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "e958ff05bd794a0496045351b3a629d9"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.647549 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:17.656088 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:17.656388 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:17.656623 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:17.657043 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:17.657107 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.657140 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:17.657166 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.661756 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:42367
I20260620 23:03:17.661796 31677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:42367 every 8 connection(s)
I20260620 23:03:17.662190 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:17.663781 31681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:17.663949 31680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.664028 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:17.664013 31683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.664304 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:17.664343 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:17.664363 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996597664363 us; error 0 us; skew 500 ppm
I20260620 23:03:17.665022 31518 webserver.cc:460] Webserver started at http://127.30.199.130:35219/ using document root <none> and password file <none>
I20260620 23:03:17.665120 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:17.665166 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:17.665215 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:17.665527 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-1-root/instance:
uuid: "c8d232fa55064325956dcedc1e93af00"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.666677 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260620 23:03:17.667202 31688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.667383 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:17.667438 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-1-root
uuid: "c8d232fa55064325956dcedc1e93af00"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.667479 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:17.681546 31678 heartbeater.cc:347] Connected to a master server at 127.30.199.190:39689
I20260620 23:03:17.681690 31678 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:17.681857 31678 heartbeater.cc:511] Master 127.30.199.190:39689 requested a full tablet report, sending...
I20260620 23:03:17.682444 31548 ts_manager.cc:194] Registered new tserver with Master: e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:17.683076 31548 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48116
I20260620 23:03:17.706768 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:17.707276 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:17.707505 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:17.707806 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:17.707851 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.707885 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:17.707904 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.712389 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.130:36383
I20260620 23:03:17.712466 31753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.130:36383 every 8 connection(s)
I20260620 23:03:17.712885 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:17.714501 31757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:17.714641 31756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.714891 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:17.714960 31760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:17.715111 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:17.715157 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:17.715176 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996597715176 us; error 0 us; skew 500 ppm
I20260620 23:03:17.715962 31518 webserver.cc:460] Webserver started at http://127.30.199.131:43235/ using document root <none> and password file <none>
I20260620 23:03:17.716053 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:17.716117 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:17.716158 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:17.716472 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-2-root/instance:
uuid: "2aae72e27c8349aa99eecc09eceeaece"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.717128 31754 heartbeater.cc:347] Connected to a master server at 127.30.199.190:39689
I20260620 23:03:17.717175 31754 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:17.717236 31754 heartbeater.cc:511] Master 127.30.199.190:39689 requested a full tablet report, sending...
I20260620 23:03:17.717449 31548 ts_manager.cc:194] Registered new tserver with Master: c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:17.717618 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260620 23:03:17.717803 31548 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48122
I20260620 23:03:17.718204 31765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.718314 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.718353 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-2-root
uuid: "2aae72e27c8349aa99eecc09eceeaece"
format_stamp: "Formatted at 2026-06-20 23:03:17 on dist-test-slave-z4c6"
I20260620 23:03:17.718407 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:17.725828 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:17.726132 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:17.726284 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:17.726542 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:17.726583 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.726614 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:17.726639 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.731122 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.131:39569
I20260620 23:03:17.731222 31828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.131:39569 every 8 connection(s)
I20260620 23:03:17.735496 31829 heartbeater.cc:347] Connected to a master server at 127.30.199.190:39689
I20260620 23:03:17.735580 31829 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:17.735661 31829 heartbeater.cc:511] Master 127.30.199.190:39689 requested a full tablet report, sending...
I20260620 23:03:17.735985 31548 ts_manager.cc:194] Registered new tserver with Master: 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569)
I20260620 23:03:17.736363 31548 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48130
I20260620 23:03:17.736979 31518 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005614604s
I20260620 23:03:17.747902 31518 test_util.cc:268] Using random seed: 1781735610
I20260620 23:03:17.755879 31548 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48166:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 23:03:17.756192 31548 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 23:03:17.763111 31793 tablet_service.cc:1467] Processing CreateTablet for tablet e5c6e030336e490c8b6a4c3ee3f98043 (DEFAULT_TABLE table=test-workload [id=be958b39d5c541a0b13eba86d260dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:17.763111 31718 tablet_service.cc:1467] Processing CreateTablet for tablet e5c6e030336e490c8b6a4c3ee3f98043 (DEFAULT_TABLE table=test-workload [id=be958b39d5c541a0b13eba86d260dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:17.763336 31793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c6e030336e490c8b6a4c3ee3f98043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:17.764009 31642 tablet_service.cc:1467] Processing CreateTablet for tablet e5c6e030336e490c8b6a4c3ee3f98043 (DEFAULT_TABLE table=test-workload [id=be958b39d5c541a0b13eba86d260dd7f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:17.764173 31642 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c6e030336e490c8b6a4c3ee3f98043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:17.765331 31850 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Bootstrap starting.
I20260620 23:03:17.765523 31851 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Bootstrap starting.
I20260620 23:03:17.763336 31718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5c6e030336e490c8b6a4c3ee3f98043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:17.765851 31850 tablet_bootstrap.cc:654] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:17.765949 31851 tablet_bootstrap.cc:654] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:17.766597 31850 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: No bootstrap required, opened a new log
I20260620 23:03:17.766659 31850 ts_tablet_manager.cc:1397] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:17.766814 31850 raft_consensus.cc:348] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.766916 31850 raft_consensus.cc:374] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:17.766939 31850 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Initialized, Role: FOLLOWER
I20260620 23:03:17.767017 31850 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.767346 31850 ts_tablet_manager.cc:1428] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:17.767525 31829 heartbeater.cc:503] Master 127.30.199.190:39689 was elected leader, sending a full tablet report...
I20260620 23:03:17.767782 31851 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: No bootstrap required, opened a new log
I20260620 23:03:17.767904 31851 ts_tablet_manager.cc:1397] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260620 23:03:17.767797 31854 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Bootstrap starting.
I20260620 23:03:17.768476 31854 tablet_bootstrap.cc:654] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:17.769275 31851 raft_consensus.cc:348] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.769379 31851 raft_consensus.cc:374] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:17.769404 31851 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Initialized, Role: FOLLOWER
I20260620 23:03:17.769457 31851 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.769615 31851 ts_tablet_manager.cc:1428] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:17.769816 31854 tablet_bootstrap.cc:492] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: No bootstrap required, opened a new log
I20260620 23:03:17.769914 31678 heartbeater.cc:503] Master 127.30.199.190:39689 was elected leader, sending a full tablet report...
I20260620 23:03:17.769913 31854 ts_tablet_manager.cc:1397] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260620 23:03:17.770098 31854 raft_consensus.cc:348] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.770323 31854 raft_consensus.cc:374] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:17.770359 31854 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Initialized, Role: FOLLOWER
I20260620 23:03:17.770449 31854 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.770663 31754 heartbeater.cc:503] Master 127.30.199.190:39689 was elected leader, sending a full tablet report...
I20260620 23:03:17.770773 31854 ts_tablet_manager.cc:1428] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:17.782464 31853 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 23:03:17.782578 31853 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.782905 31853 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:17.786799 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00" is_pre_election: true
I20260620 23:03:17.786783 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9" is_pre_election: true
I20260620 23:03:17.786979 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 0.
I20260620 23:03:17.786979 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 0.
I20260620 23:03:17.787184 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:17.787292 31853 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 23:03:17.787359 31853 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:17.787385 31853 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:17.788347 31853 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.788501 31853 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 1 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:17.788676 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:17.788676 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:17.788785 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:17.788785 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:17.789513 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 1.
I20260620 23:03:17.789513 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 1.
I20260620 23:03:17.789693 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:17.789821 31853 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:17.789969 31853 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:17.790021 31853 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:17.790738 31548 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 0 to 1, leader changed from <none> to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 1 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:17.800139 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 1 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:17.800137 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 1 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:17.800417 31853 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:17.800590 31860 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:17.815568 31518 test_util.cc:268] Using random seed: 1781803279
I20260620 23:03:17.821802 31518 test_workload.cc:401] TestWorkload: Skipping table creation because table test-workload already exists
I20260620 23:03:18.127936 31858 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:18.128042 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:18.128948 31858 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.129186 31858 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 2 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.133234 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.133240 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.133549 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:18.133644 31858 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 23:03:18.137619 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 1. Current term is 2. Ops: []
I20260620 23:03:18.137925 31868 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
W20260620 23:03:18.138151 31860 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260620 23:03:18.138204 31860 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260620 23:03:18.141824 31857 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:18.141901 31857 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:18.142552 31857 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.142807 31857 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 2 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:18.145614 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.145629 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 2 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.145725 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 2: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:18.145936 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:18.146056 31857 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 23:03:18.162348 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 2 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 1. Current term is 2. Ops: []
I20260620 23:03:18.162652 31868 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 1.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260620 23:03:18.212383 31860 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 LEADER]: Stepping down as leader of term 1
I20260620 23:03:18.212489 31860 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:18.212612 31860 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.212837 31860 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:18.258311 31858 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:18.258419 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:18.259167 31858 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.259372 31858 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 3 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.259625 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.259696 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:18.259629 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 3 candidate_status { last_received { term: 1 index: 41 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.259774 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:18.260435 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 3.
I20260620 23:03:18.260541 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 3.
I20260620 23:03:18.260648 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: 
I20260620 23:03:18.260775 31858 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 23:03:18.260896 31858 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:18.260996 31858 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 1.41, Last appended by leader: 41, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.261538 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 1 to 3, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 3 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:18.341324 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 3 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 3 index: 42. (index mismatch)
I20260620 23:03:18.341638 31858 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260620 23:03:18.356583 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 3 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 1 index: 41. Preceding OpId from leader: term: 3 index: 42. (index mismatch)
I20260620 23:03:18.356950 31858 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260620 23:03:18.457911 31901 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:18.458042 31901 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:18.458817 31901 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.459060 31901 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 4 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:18.459291 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.459363 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.459630 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:18.459731 31901 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 23:03:18.468220 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 3. Current term is 4. Ops: []
I20260620 23:03:18.468488 31899 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260620 23:03:18.533203 31860 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 3 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:18.533321 31860 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:18.534184 31860 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.534415 31860 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 4 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.534803 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.534710 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 4 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.535012 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 4: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:18.535207 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:18.535320 31860 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 23:03:18.548987 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 4 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 3. Current term is 4. Ops: []
I20260620 23:03:18.549309 31902 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260620 23:03:18.555791 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 3. Current term is 4. Ops: []
I20260620 23:03:18.556092 31902 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 3.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260620 23:03:18.570374 31858 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 23:03:18.570485 31858 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:18.570574 31858 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.570706 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:18.593380 31901 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:18.593605 31901 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:18.594348 31901 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.594558 31901 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 5 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:18.594813 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 5 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.594798 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 5 candidate_status { last_received { term: 3 index: 42 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.594915 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:18.594966 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:18.595546 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 5.
I20260620 23:03:18.595554 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 5.
I20260620 23:03:18.595755 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:18.595837 31901 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 23:03:18.595930 31901 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:18.595989 31901 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 3.42, Last appended by leader: 42, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.596531 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 3 to 5, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 5 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:18.685688 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 5 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 42. Preceding OpId from leader: term: 5 index: 43. (index mismatch)
I20260620 23:03:18.686003 31901 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260620 23:03:18.698632 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 5 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 3 index: 42. Preceding OpId from leader: term: 5 index: 43. (index mismatch)
I20260620 23:03:18.698956 31901 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260620 23:03:18.799507 31860 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 5 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:18.799607 31860 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:18.800400 31860 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.800581 31860 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 6 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.800791 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.800791 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.801110 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:18.801234 31860 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 23:03:18.820716 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 6 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 5. Current term is 6. Ops: []
I20260620 23:03:18.821070 31857 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 5.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260620 23:03:18.887825 31903 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 23:03:18.887954 31903 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:18.888044 31903 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.888240 31903 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:18.919803 31860 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:18.919945 31860 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:18.920680 31860 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.920893 31860 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 7 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.921157 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.921142 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 7 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:18.921262 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:18.921849 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 7.
I20260620 23:03:18.922029 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:18.922155 31860 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 FOLLOWER]: Leader election won for term 7
I20260620 23:03:18.922288 31860 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:18.922348 31860 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 5.43, Last appended by leader: 43, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.922878 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 5 to 7, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 7 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:18.963891 31858 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:18.964021 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:18.964874 31858 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:18.965070 31858 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 6 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:18.965317 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:18.965317 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 6 candidate_status { last_received { term: 5 index: 43 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:18.965499 31652 raft_consensus.cc:2354] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 6. Current term is 7.
I20260620 23:03:18.965723 31691 leader_election.cc:398] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 6 election: Vote denied by peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 6. Current term is 7.
I20260620 23:03:18.965771 31691 leader_election.cc:401] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260620 23:03:18.965840 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:18.966425 31858 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 6. Current term is 7.
I20260620 23:03:19.014437 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 5 index: 43. Preceding OpId from leader: term: 7 index: 44. (index mismatch)
I20260620 23:03:19.014776 31860 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260620 23:03:19.024933 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 7 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 5 index: 43. Preceding OpId from leader: term: 7 index: 44. (index mismatch)
I20260620 23:03:19.025228 31860 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260620 23:03:19.126547 31858 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:19.126669 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:19.127365 31858 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.127589 31858 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 8 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:19.127794 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:19.127796 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:19.128104 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:19.128219 31858 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 23:03:19.137722 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 7. Current term is 8. Ops: []
I20260620 23:03:19.138010 31905 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 7.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260620 23:03:19.240322 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 7. Current term is 8. Ops: []
I20260620 23:03:19.240674 31860 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 7.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260620 23:03:19.252493 31904 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 LEADER]: Stepping down as leader of term 7
I20260620 23:03:19.252588 31904 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:19.252696 31904 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 7.44, Last appended by leader: 44, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.252818 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:19.260941 31858 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:19.261076 31858 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:19.261785 31858 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.262086 31858 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 9 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:19.262302 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 9 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:19.262414 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:19.262380 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 9 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:19.263103 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 9.
I20260620 23:03:19.263351 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:19.263478 31858 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 23:03:19.263648 31858 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:19.263695 31858 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 7.44, Last appended by leader: 44, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.264170 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 7 to 9, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 9 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:19.300944 31903 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:19.301047 31903 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:19.301765 31903 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.302065 31903 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 8 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:19.302172 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:19.302256 31803 raft_consensus.cc:2354] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for earlier term 8. Current term is 9.
I20260620 23:03:19.302217 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 8 candidate_status { last_received { term: 7 index: 44 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:19.302469 31618 leader_election.cc:398] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 8 election: Vote denied by peer 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for earlier term 8. Current term is 9.
I20260620 23:03:19.302531 31618 leader_election.cc:401] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260620 23:03:19.302639 31903 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:19.303217 31903 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for earlier term 8. Current term is 9.
I20260620 23:03:19.357862 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 9 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 7 index: 44. Preceding OpId from leader: term: 9 index: 45. (index mismatch)
I20260620 23:03:19.357869 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 7 index: 44. Preceding OpId from leader: term: 9 index: 45. (index mismatch)
I20260620 23:03:19.358261 31906 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260620 23:03:19.358371 31858 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260620 23:03:19.459587 31903 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:19.459722 31903 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 9 FOLLOWER]: Advancing to term 10
I20260620 23:03:19.460474 31903 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.460659 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 9. Current term is 10. Ops: []
I20260620 23:03:19.460814 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 10 candidate_status { last_received { term: 9 index: 45 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:19.460814 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 10 candidate_status { last_received { term: 9 index: 45 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:19.460958 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 9 FOLLOWER]: Advancing to term 10
I20260620 23:03:19.461090 31903 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 10 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:19.461338 31906 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 9.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260620 23:03:19.461691 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 10.
I20260620 23:03:19.461879 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:19.461983 31903 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 FOLLOWER]: Leader election won for term 10
I20260620 23:03:19.462087 31903 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:19.462131 31903 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 9.45, Last appended by leader: 45, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.462625 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 9 to 10, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 10 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:19.476311 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 10 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 9. Current term is 10. Ops: []
I20260620 23:03:19.476653 31907 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 9.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260620 23:03:19.542166 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 10 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 9 index: 45. Preceding OpId from leader: term: 10 index: 46. (index mismatch)
I20260620 23:03:19.542537 31903 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260620 23:03:19.553238 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 9. Current term is 10. Ops: []
I20260620 23:03:19.553637 31858 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 9.45, Next index: 46, Last known committed idx: 46, Time since last communication: 0.000s
I20260620 23:03:19.553742 31858 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 10.46 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 46
I20260620 23:03:19.555744 31728 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 23:03:19.555806 31728 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:19.555898 31728 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 9.45, Last appended by leader: 45, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.555991 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 9 FOLLOWER]: Advancing to term 10
I20260620 23:03:19.556635 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 10 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 9 index: 45. Preceding OpId from leader: term: 10 index: 46. (index mismatch)
I20260620 23:03:19.556866 31909 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260620 23:03:19.644354 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 10 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:19.644452 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 10 FOLLOWER]: Advancing to term 11
I20260620 23:03:19.645154 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.645380 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 11 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:19.645583 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:19.645658 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:19.645923 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:19.646023 31904 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 23:03:19.663025 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 11 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 10. Current term is 11. Ops: []
I20260620 23:03:19.663436 31903 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 10.46, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260620 23:03:19.724815 31908 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 LEADER]: Stepping down as leader of term 10
I20260620 23:03:19.724933 31908 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:19.725019 31908 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 10.46, Last appended by leader: 46, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.725145 31908 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 10 FOLLOWER]: Advancing to term 11
I20260620 23:03:19.729673 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.731078 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.733238 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.737387 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.745573 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.756908 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:19.757001 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 11 FOLLOWER]: Advancing to term 12
I20260620 23:03:19.757726 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.757913 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 12 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:19.758157 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 12 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:19.758206 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 12 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:19.758338 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 11 FOLLOWER]: Advancing to term 12
I20260620 23:03:19.759001 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 12.
I20260620 23:03:19.759207 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:19.759341 31904 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 FOLLOWER]: Leader election won for term 12
I20260620 23:03:19.759413 31904 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:19.759474 31904 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 46, Committed index: 46, Last appended: 10.46, Last appended by leader: 46, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.759981 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 10 to 12, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 12 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:19.761763 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.782083 31906 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:19.782189 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 10 FOLLOWER]: Advancing to term 11
I20260620 23:03:19.782932 31906 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:19.783136 31906 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 11 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:19.783365 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:19.783375 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 11 candidate_status { last_received { term: 10 index: 46 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:19.783538 31652 raft_consensus.cc:2354] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 11. Current term is 12.
I20260620 23:03:19.783741 31691 leader_election.cc:398] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 11 election: Vote denied by peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 11. Current term is 12.
I20260620 23:03:19.783795 31691 leader_election.cc:401] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260620 23:03:19.783895 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 11 FOLLOWER]: Advancing to term 12
I20260620 23:03:19.784886 31906 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367) with higher term. Message: Invalid argument: T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 for earlier term 11. Current term is 12.
I20260620 23:03:19.793979 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.858258 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:19.867841 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 12 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 10 index: 46. Preceding OpId from leader: term: 12 index: 47. (index mismatch)
I20260620 23:03:19.868224 31904 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260620 23:03:19.869308 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 10 index: 46. Preceding OpId from leader: term: 12 index: 47. (index mismatch)
I20260620 23:03:19.869514 31910 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 47, Last known committed idx: 46, Time since last communication: 0.000s
I20260620 23:03:19.986531 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:20.045895 31906 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:20.046023 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:20.046711 31906 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.046904 31906 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 13 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.047142 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 13 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.047187 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 13 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.047454 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:20.047581 31906 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260620 23:03:20.055359 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 12. Current term is 13. Ops: []
I20260620 23:03:20.055646 31904 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 12.47, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260620 23:03:20.055768 31904 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 LEADER]: Stepping down as leader of term 12
I20260620 23:03:20.055812 31904 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:20.055871 31904 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 12.47, Last appended by leader: 47, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.056007 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:20.142001 31909 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:20.142102 31909 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:20.142840 31909 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.143064 31909 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 13 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:20.143280 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 13 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.143291 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 13 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:20.143481 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 13: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:20.143903 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 13.
I20260620 23:03:20.144120 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:20.144215 31909 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 FOLLOWER]: Leader election won for term 13
I20260620 23:03:20.144292 31909 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:20.144346 31909 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 12.47, Last appended by leader: 47, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.144797 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 12 to 13, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 13 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:20.174471 31906 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:20.174553 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:20.175267 31906 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.175447 31906 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 14 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.175662 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 14 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.175671 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 14 candidate_status { last_received { term: 12 index: 47 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.175774 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:20.176367 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 14.
I20260620 23:03:20.176555 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:20.176656 31906 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 FOLLOWER]: Leader election won for term 14
I20260620 23:03:20.176761 31906 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:20.176803 31906 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 12.47, Last appended by leader: 47, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.177223 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 13 to 14, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 14 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:20.226555 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 14 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 13. Current term is 14. Ops: []
I20260620 23:03:20.226890 31909 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260620 23:03:20.227067 31909 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 LEADER]: Stepping down as leader of term 13
I20260620 23:03:20.227113 31909 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:20.227178 31909 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 47, Committed index: 47, Last appended: 13.48, Last appended by leader: 48, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.227241 31909 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:20.242799 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:20.263072 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 14 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 13 index: 48. Preceding OpId from leader: term: 14 index: 48. (term mismatch)
I20260620 23:03:20.263214 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 47
I20260620 23:03:20.263242 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 13.48
I20260620 23:03:20.263355 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:20.263675 31906 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260620 23:03:20.264807 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 14 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 12 index: 47. Preceding OpId from leader: term: 14 index: 48. (index mismatch)
I20260620 23:03:20.265033 31906 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 48, Last known committed idx: 47, Time since last communication: 0.000s
I20260620 23:03:20.474251 31909 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:20.474362 31909 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:20.475047 31909 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.475232 31909 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 15 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:20.475486 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 15 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:20.475489 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 15 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.475823 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:20.475924 31909 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260620 23:03:20.494524 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 14. Current term is 15. Ops: []
I20260620 23:03:20.494853 31911 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 14.48, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260620 23:03:20.494997 31911 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 LEADER]: Stepping down as leader of term 14
I20260620 23:03:20.495018 31911 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:20.495107 31911 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 14.48, Last appended by leader: 48, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.495225 31911 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:20.562361 31910 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 14 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:20.562500 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:20.563287 31910 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.563515 31910 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 15 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.563745 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 15 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:20.563750 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 15 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.563930 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 15: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:20.564527 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 15.
I20260620 23:03:20.564932 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:20.565061 31910 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 FOLLOWER]: Leader election won for term 15
I20260620 23:03:20.565153 31910 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:20.565214 31910 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 14.48, Last appended by leader: 48, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.565873 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 14 to 15, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 15 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:20.604624 31909 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:20.604763 31909 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:20.605465 31909 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.605687 31909 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 16 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:20.605865 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 16 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.606057 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 16 candidate_status { last_received { term: 14 index: 48 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:20.606197 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:20.606781 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 16.
I20260620 23:03:20.607077 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:20.607203 31909 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 23:03:20.607265 31909 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:20.607348 31909 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 14.48, Last appended by leader: 48, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.607877 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 15 to 16, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 16 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:20.677385 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 16 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 15. Current term is 16. Ops: []
I20260620 23:03:20.677711 31910 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260620 23:03:20.677868 31910 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 LEADER]: Stepping down as leader of term 15
I20260620 23:03:20.677906 31910 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:20.677995 31910 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 48, Committed index: 48, Last appended: 15.49, Last appended by leader: 49, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.678102 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:20.693715 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 16 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 15 index: 49. Preceding OpId from leader: term: 16 index: 49. (term mismatch)
I20260620 23:03:20.693792 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 48
I20260620 23:03:20.693819 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 15.49
I20260620 23:03:20.693835 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:20.694134 31909 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260620 23:03:20.695436 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 16 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 14 index: 48. Preceding OpId from leader: term: 16 index: 49. (index mismatch)
I20260620 23:03:20.695705 31913 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 49, Last known committed idx: 48, Time since last communication: 0.000s
I20260620 23:03:20.755147 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:20.796361 31911 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:20.796509 31911 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:20.797230 31911 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.797454 31911 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 17 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.797729 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 17 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.797729 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 17 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.798046 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:20.798171 31911 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260620 23:03:20.804555 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 16. Current term is 17. Ops: []
I20260620 23:03:20.804809 31913 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 16.49, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260620 23:03:20.804940 31913 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 23:03:20.804976 31913 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:20.805034 31913 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 16.49, Last appended by leader: 49, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.805121 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:20.903987 31910 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 16 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:20.904158 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:20.905210 31910 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.905426 31910 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 17 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.905658 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 17 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.905658 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 17 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:20.906252 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 17: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:20.906560 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 17.
I20260620 23:03:20.906783 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:20.906908 31910 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 FOLLOWER]: Leader election won for term 17
I20260620 23:03:20.906999 31910 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:20.907063 31910 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 16.49, Last appended by leader: 49, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.907647 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 16 to 17, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 17 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:20.915733 31911 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:20.915824 31911 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:20.916608 31911 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.916811 31911 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 18 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:20.917032 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 18 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:20.917028 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 18 candidate_status { last_received { term: 16 index: 49 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:20.917143 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:20.917730 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 18.
I20260620 23:03:20.917940 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:20.918035 31911 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 23:03:20.918088 31911 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:20.918144 31911 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 16.49, Last appended by leader: 49, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.918663 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 17 to 18, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 18 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:20.995447 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 17. Current term is 18. Ops: []
I20260620 23:03:20.995783 31910 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260620 23:03:20.995951 31910 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 18.50 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 49
I20260620 23:03:20.995988 31904 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 LEADER]: Stepping down as leader of term 17
I20260620 23:03:20.996032 31904 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:20.996130 31904 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 49, Committed index: 49, Last appended: 17.50, Last appended by leader: 50, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:20.996250 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:21.004563 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 18 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 16 index: 49. Preceding OpId from leader: term: 18 index: 50. (index mismatch)
I20260620 23:03:21.004913 31911 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260620 23:03:21.006289 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 18 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 17 index: 50. Preceding OpId from leader: term: 18 index: 50. (term mismatch)
I20260620 23:03:21.006353 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 49
I20260620 23:03:21.006379 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 17.50
I20260620 23:03:21.006407 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:21.006824 31911 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 50, Last known committed idx: 49, Time since last communication: 0.000s
I20260620 23:03:21.106464 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 18 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:21.106572 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:21.107306 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.107523 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 19 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:21.107802 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 19 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.107825 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 19 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:21.108119 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:21.108237 31913 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260620 23:03:21.109500 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 18. Current term is 19. Ops: []
I20260620 23:03:21.109807 31906 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 18.50, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 23:03:21.109911 31906 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 LEADER]: Stepping down as leader of term 18
I20260620 23:03:21.109932 31906 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:21.109995 31906 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 18.50, Last appended by leader: 50, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.110074 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:21.221891 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 18 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:21.222023 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:21.222683 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.222898 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 19 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.223096 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 19 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.223136 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 19 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:21.223258 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 19: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:21.223794 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 19.
I20260620 23:03:21.224048 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:21.224218 31904 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 FOLLOWER]: Leader election won for term 19
I20260620 23:03:21.224291 31904 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:21.224400 31904 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 18.50, Last appended by leader: 50, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.224887 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 18 to 19, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 19 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:21.247889 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:21.248148 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:21.249047 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.249295 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 20 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:21.249523 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 20 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:21.249554 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 20 candidate_status { last_received { term: 18 index: 50 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.249652 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:21.250213 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 20.
I20260620 23:03:21.250397 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:21.250514 31913 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 FOLLOWER]: Leader election won for term 20
I20260620 23:03:21.250589 31913 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:21.250646 31913 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 18.50, Last appended by leader: 50, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.251147 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 19 to 20, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 20 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:21.336743 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 20 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 18 index: 50. Preceding OpId from leader: term: 20 index: 51. (index mismatch)
I20260620 23:03:21.337153 31913 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 23:03:21.338394 31803 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 LEADER]: Stepping down as leader of term 19
I20260620 23:03:21.338455 31803 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:21.338517 31803 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 50, Committed index: 50, Last appended: 19.51, Last appended by leader: 51, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.338582 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 19. Current term is 20. Ops: []
I20260620 23:03:21.338613 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:21.339344 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 20 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 19 index: 51. Preceding OpId from leader: term: 20 index: 51. (term mismatch)
I20260620 23:03:21.339416 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 50
I20260620 23:03:21.339437 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 19.51
I20260620 23:03:21.339457 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:21.339740 31909 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 51, Last known committed idx: 50, Time since last communication: 0.000s
I20260620 23:03:21.439013 31906 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:21.439131 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:21.439941 31906 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.440223 31906 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 21 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.440382 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 21 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:21.440387 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 21 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:21.440734 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:21.440842 31906 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260620 23:03:21.441262 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 20. Current term is 21. Ops: []
I20260620 23:03:21.441646 31913 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 20.51, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260620 23:03:21.441753 31913 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 LEADER]: Stepping down as leader of term 20
I20260620 23:03:21.441771 31913 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:21.441833 31913 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 20.51, Last appended by leader: 51, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.441913 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:21.564524 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 20 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:21.564649 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:21.565342 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.565555 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 21 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.565797 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 21 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.565877 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 21: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:21.565804 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 21 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:21.566548 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 21.
I20260620 23:03:21.566821 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:21.566964 31904 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 FOLLOWER]: Leader election won for term 21
I20260620 23:03:21.567065 31904 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:21.567150 31904 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 20.51, Last appended by leader: 51, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.567678 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 20 to 21, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 21 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:21.586772 31906 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:21.586882 31906 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:21.587563 31906 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.587841 31906 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 22 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.587970 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 22 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:21.587984 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 22 candidate_status { last_received { term: 20 index: 51 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:21.588088 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:21.588702 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 22.
I20260620 23:03:21.588896 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:21.588989 31906 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 FOLLOWER]: Leader election won for term 22
I20260620 23:03:21.589047 31906 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:21.589082 31906 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 20.51, Last appended by leader: 51, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.589589 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 21 to 22, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 22 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:21.654383 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 22 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 21. Current term is 22. Ops: []
I20260620 23:03:21.654697 31904 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260620 23:03:21.654856 31904 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 LEADER]: Stepping down as leader of term 21
I20260620 23:03:21.654896 31904 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:21.654960 31904 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 51, Committed index: 51, Last appended: 21.52, Last appended by leader: 52, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.655038 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:21.690418 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 22 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 21 index: 52. Preceding OpId from leader: term: 22 index: 52. (term mismatch)
I20260620 23:03:21.690531 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 51
I20260620 23:03:21.690555 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 21.52
I20260620 23:03:21.690582 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:21.690881 31906 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260620 23:03:21.692214 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 22 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 20 index: 51. Preceding OpId from leader: term: 22 index: 52. (index mismatch)
I20260620 23:03:21.692431 31916 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 52, Last known committed idx: 51, Time since last communication: 0.000s
I20260620 23:03:21.755455 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:21.892176 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 22 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:21.892277 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:21.893003 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.893301 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 23 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.893429 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.893429 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:21.893961 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:21.894095 31904 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260620 23:03:21.906390 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 22. Current term is 23. Ops: []
I20260620 23:03:21.906736 31916 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 22.52, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260620 23:03:21.906914 31916 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 LEADER]: Stepping down as leader of term 22
I20260620 23:03:21.906937 31916 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:21.907007 31916 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 22.52, Last appended by leader: 52, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.907114 31916 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:21.953671 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 22 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:21.953776 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:21.954494 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.954789 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 23 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:21.955026 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:21.955026 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 23 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:21.955166 31803 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 23: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:21.955757 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 23.
I20260620 23:03:21.955953 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:21.956082 31913 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 FOLLOWER]: Leader election won for term 23
I20260620 23:03:21.956225 31913 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:21.956296 31913 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 22.52, Last appended by leader: 52, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.956897 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 22 to 23, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 23 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:21.998664 31904 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:21.998793 31904 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 23 FOLLOWER]: Advancing to term 24
I20260620 23:03:21.999514 31904 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:21.999732 31904 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 24 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:21.999965 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:22.000103 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 23 FOLLOWER]: Advancing to term 24
I20260620 23:03:22.000023 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 24 candidate_status { last_received { term: 22 index: 52 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:22.000810 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 24.
I20260620 23:03:22.001051 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:22.001197 31904 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 FOLLOWER]: Leader election won for term 24
I20260620 23:03:22.001262 31904 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:22.001334 31904 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 22.52, Last appended by leader: 52, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.001879 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 23 to 24, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 24 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:22.067866 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 24 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 23. Current term is 24. Ops: []
I20260620 23:03:22.068337 31913 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260620 23:03:22.068470 31913 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 LEADER]: Stepping down as leader of term 23
I20260620 23:03:22.068496 31913 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:22.068584 31913 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 52, Committed index: 52, Last appended: 23.53, Last appended by leader: 53, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.068681 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 23 FOLLOWER]: Advancing to term 24
I20260620 23:03:22.103610 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 24 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 22 index: 52. Preceding OpId from leader: term: 24 index: 53. (index mismatch)
I20260620 23:03:22.103991 31904 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260620 23:03:22.105325 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 24 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 23 index: 53. Preceding OpId from leader: term: 24 index: 53. (term mismatch)
I20260620 23:03:22.105410 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 52
I20260620 23:03:22.105437 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 23.53
I20260620 23:03:22.105459 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:22.105612 31918 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 53, Last known committed idx: 52, Time since last communication: 0.000s
I20260620 23:03:22.206094 31916 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:22.206215 31916 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 24 FOLLOWER]: Advancing to term 25
I20260620 23:03:22.206920 31916 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.207118 31916 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 25 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:22.207342 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:22.207350 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.207675 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:22.207837 31916 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260620 23:03:22.215468 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 24. Current term is 25. Ops: []
I20260620 23:03:22.215798 31904 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 24.53, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260620 23:03:22.215960 31910 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 LEADER]: Stepping down as leader of term 24
I20260620 23:03:22.216008 31910 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:22.216113 31910 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.216212 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 24 FOLLOWER]: Advancing to term 25
I20260620 23:03:22.294521 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:22.294649 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 24 FOLLOWER]: Advancing to term 25
I20260620 23:03:22.295414 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.295652 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 25 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:22.295923 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.295923 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 25 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:22.296141 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 25: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:22.296904 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 25.
I20260620 23:03:22.297106 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:22.297237 31913 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 FOLLOWER]: Leader election won for term 25
I20260620 23:03:22.297300 31913 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:22.297365 31913 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.297961 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 24 to 25, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 25 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:22.324532 31916 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:22.324674 31916 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 25 FOLLOWER]: Advancing to term 26
I20260620 23:03:22.325469 31916 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.325695 31916 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 26 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:22.325927 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 26 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.326004 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 26 candidate_status { last_received { term: 24 index: 53 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:22.326072 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 25 FOLLOWER]: Advancing to term 26
I20260620 23:03:22.326763 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 26.
I20260620 23:03:22.326973 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:22.327085 31916 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 FOLLOWER]: Leader election won for term 26
I20260620 23:03:22.327169 31916 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:22.327250 31916 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 24.53, Last appended by leader: 53, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.327834 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 25 to 26, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 26 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:22.377415 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 26 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 25. Current term is 26. Ops: []
I20260620 23:03:22.377807 31913 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260620 23:03:22.377959 31913 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 LEADER]: Stepping down as leader of term 25
I20260620 23:03:22.378011 31913 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:22.378075 31913 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 53, Committed index: 53, Last appended: 25.54, Last appended by leader: 54, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.378132 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 25 FOLLOWER]: Advancing to term 26
I20260620 23:03:22.410615 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 26 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 25 index: 54. Preceding OpId from leader: term: 26 index: 54. (term mismatch)
I20260620 23:03:22.410732 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 53
I20260620 23:03:22.410756 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 25.54
I20260620 23:03:22.410778 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:22.411082 31916 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260620 23:03:22.412433 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 26 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 24 index: 53. Preceding OpId from leader: term: 26 index: 54. (index mismatch)
I20260620 23:03:22.412635 31919 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 54, Last known committed idx: 53, Time since last communication: 0.000s
I20260620 23:03:22.598919 31910 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 26 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:22.599067 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 26 FOLLOWER]: Advancing to term 27
I20260620 23:03:22.599869 31910 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.600183 31910 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 27 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:22.600474 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:22.600479 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:22.600862 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:22.600971 31910 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260620 23:03:22.609107 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 26 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:22.609198 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 26 FOLLOWER]: Advancing to term 27
I20260620 23:03:22.609951 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.610174 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 27 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:22.610447 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:22.610447 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 27 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.610608 31803 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 27: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:22.610811 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:22.610958 31913 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260620 23:03:22.611672 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 27 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 26. Current term is 27. Ops: []
I20260620 23:03:22.611971 31911 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 26.54, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260620 23:03:22.612149 31919 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 LEADER]: Stepping down as leader of term 26
I20260620 23:03:22.612197 31919 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:22.612293 31919 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.612434 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 26 FOLLOWER]: Advancing to term 27
I20260620 23:03:22.711586 31913 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:22.711771 31913 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 27 FOLLOWER]: Advancing to term 28
I20260620 23:03:22.712621 31913 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.712863 31913 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 28 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:22.713162 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:22.713274 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 27 FOLLOWER]: Advancing to term 28
I20260620 23:03:22.713160 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 28 candidate_status { last_received { term: 26 index: 54 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.713322 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 27 FOLLOWER]: Advancing to term 28
I20260620 23:03:22.713965 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 28.
I20260620 23:03:22.713969 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 28.
I20260620 23:03:22.714200 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:22.714316 31913 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 FOLLOWER]: Leader election won for term 28
I20260620 23:03:22.714404 31913 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:22.714463 31913 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 54, Committed index: 54, Last appended: 26.54, Last appended by leader: 54, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.715071 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 26 to 28, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 28 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:22.755784 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:22.807739 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 28 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260620 23:03:22.808157 31913 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260620 23:03:22.809401 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 28 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 26 index: 54. Preceding OpId from leader: term: 28 index: 55. (index mismatch)
I20260620 23:03:22.809676 31913 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 55, Last known committed idx: 54, Time since last communication: 0.000s
I20260620 23:03:22.910841 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 28 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:22.910956 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 28 FOLLOWER]: Advancing to term 29
I20260620 23:03:22.911859 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.912213 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 29 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:22.912237 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:22.912601 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 28. Current term is 29. Ops: []
I20260620 23:03:22.912875 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:22.913110 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:22.913200 31919 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260620 23:03:22.912757 31917 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 28.55, Next index: 56, Last known committed idx: 55, Time since last communication: 0.001s
I20260620 23:03:22.913393 31917 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 LEADER]: Stepping down as leader of term 28
I20260620 23:03:22.913436 31917 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:22.913486 31917 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:22.913565 31917 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 28 FOLLOWER]: Advancing to term 29
I20260620 23:03:22.999837 31910 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 28 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:22.999990 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 28 FOLLOWER]: Advancing to term 29
I20260620 23:03:23.000766 31910 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.000985 31910 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 29 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.001214 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.001214 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 29 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:23.001504 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 29: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:23.002110 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 29.
I20260620 23:03:23.002349 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:23.002478 31910 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 FOLLOWER]: Leader election won for term 29
I20260620 23:03:23.002590 31910 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:23.002658 31910 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.003177 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 28 to 29, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 29 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:23.016883 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:23.017011 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 29 FOLLOWER]: Advancing to term 30
I20260620 23:03:23.017760 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.018177 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 30 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.018335 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.018342 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 30 candidate_status { last_received { term: 28 index: 55 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.018488 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 29 FOLLOWER]: Advancing to term 30
I20260620 23:03:23.019156 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 30.
I20260620 23:03:23.019361 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:23.019484 31919 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 FOLLOWER]: Leader election won for term 30
I20260620 23:03:23.019541 31919 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:23.019600 31919 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 28.55, Last appended by leader: 55, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.020182 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 29 to 30, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 30 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:23.105118 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 29. Current term is 30. Ops: []
I20260620 23:03:23.105484 31910 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260620 23:03:23.105608 31910 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 30.56 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 55
I20260620 23:03:23.105634 31910 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 LEADER]: Stepping down as leader of term 29
I20260620 23:03:23.105649 31910 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:23.105716 31910 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 55, Committed index: 55, Last appended: 29.56, Last appended by leader: 56, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.105795 31910 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 29 FOLLOWER]: Advancing to term 30
I20260620 23:03:23.115087 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 30 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 28 index: 55. Preceding OpId from leader: term: 30 index: 56. (index mismatch)
I20260620 23:03:23.115410 31919 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260620 23:03:23.116690 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 30 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 29 index: 56. Preceding OpId from leader: term: 30 index: 56. (term mismatch)
I20260620 23:03:23.116751 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 55
I20260620 23:03:23.116775 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 29.56
I20260620 23:03:23.116801 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 30 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:23.117059 31922 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 56, Last known committed idx: 55, Time since last communication: 0.000s
I20260620 23:03:23.217496 31917 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 30 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:23.217645 31917 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 30 FOLLOWER]: Advancing to term 31
I20260620 23:03:23.218462 31917 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.218679 31917 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 31 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:23.218947 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.219074 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 30 FOLLOWER]: Advancing to term 31
I20260620 23:03:23.218962 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 31 candidate_status { last_received { term: 30 index: 56 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:23.219708 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 31.
I20260620 23:03:23.219937 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:23.220048 31917 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 FOLLOWER]: Leader election won for term 31
I20260620 23:03:23.220153 31917 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:23.220212 31917 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.220726 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 30 to 31, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 31 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:23.234982 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 31 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 30. Current term is 31. Ops: []
I20260620 23:03:23.235314 31919 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 30.56, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260620 23:03:23.235443 31919 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 LEADER]: Stepping down as leader of term 30
I20260620 23:03:23.235461 31919 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:23.235535 31919 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 56, Committed index: 56, Last appended: 30.56, Last appended by leader: 56, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.235615 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 30 FOLLOWER]: Advancing to term 31
I20260620 23:03:23.340533 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 31 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 31 index: 57. (index mismatch)
I20260620 23:03:23.340879 31917 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260620 23:03:23.342177 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 31 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 30 index: 56. Preceding OpId from leader: term: 31 index: 57. (index mismatch)
I20260620 23:03:23.342371 31920 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 57, Last known committed idx: 56, Time since last communication: 0.000s
I20260620 23:03:23.443866 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 31 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:23.444018 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 31 FOLLOWER]: Advancing to term 32
I20260620 23:03:23.444939 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.445127 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 32 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.445338 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.445359 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:23.445645 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 32 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:23.445734 31921 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Leader election lost for term 32. Reason: could not achieve majority
I20260620 23:03:23.464537 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 31. Current term is 32. Ops: []
I20260620 23:03:23.464861 31917 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 31.57, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260620 23:03:23.465030 31920 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 LEADER]: Stepping down as leader of term 31
I20260620 23:03:23.465088 31920 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:23.465161 31920 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.57, Last appended by leader: 57, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.465309 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 31 FOLLOWER]: Advancing to term 32
I20260620 23:03:23.545463 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 31 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:23.545630 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 31 FOLLOWER]: Advancing to term 32
I20260620 23:03:23.546419 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.546648 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 32 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.546872 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.546995 31803 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 32: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:23.546881 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 32 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.547693 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 32.
I20260620 23:03:23.547905 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:23.548012 31919 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 FOLLOWER]: Leader election won for term 32
I20260620 23:03:23.548118 31919 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:23.548182 31919 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.57, Last appended by leader: 57, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.548643 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 31 to 32, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 32 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:23.560424 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:23.560519 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 32 FOLLOWER]: Advancing to term 33
I20260620 23:03:23.561311 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.561517 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 33 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.561712 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 33 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:23.561717 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 33 candidate_status { last_received { term: 31 index: 57 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.561851 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 32 FOLLOWER]: Advancing to term 33
I20260620 23:03:23.562529 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 33 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 33.
I20260620 23:03:23.562748 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 33 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:23.562862 31921 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 FOLLOWER]: Leader election won for term 33
I20260620 23:03:23.562948 31921 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:23.563032 31921 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 31.57, Last appended by leader: 57, Current term: 33, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.563517 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 32 to 33, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 33 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:23.640200 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 32. Current term is 33. Ops: []
I20260620 23:03:23.640363 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 33 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 32. Current term is 33. Ops: []
I20260620 23:03:23.640504 31919 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260620 23:03:23.640637 31919 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 33.58 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 57
I20260620 23:03:23.640676 31919 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260620 23:03:23.640676 31922 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 LEADER]: Stepping down as leader of term 32
I20260620 23:03:23.640848 31922 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:23.640936 31922 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 57, Committed index: 57, Last appended: 32.58, Last appended by leader: 58, Current term: 32, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.641032 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 32 FOLLOWER]: Advancing to term 33
I20260620 23:03:23.676451 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 33 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 32 index: 58. Preceding OpId from leader: term: 33 index: 58. (term mismatch)
I20260620 23:03:23.676530 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 57
I20260620 23:03:23.676544 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 32.58
I20260620 23:03:23.676560 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 33 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:23.676842 31921 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260620 23:03:23.677070 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 33 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 31 index: 57. Preceding OpId from leader: term: 33 index: 58. (index mismatch)
I20260620 23:03:23.677345 31921 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 58, Last known committed idx: 57, Time since last communication: 0.000s
I20260620 23:03:23.756076 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:23.866328 31922 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:23.866448 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 33 FOLLOWER]: Advancing to term 34
I20260620 23:03:23.867133 31922 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.867290 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 33. Current term is 34. Ops: []
I20260620 23:03:23.867341 31922 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 34 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.867508 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.867609 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.867575 31924 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 33.58, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:23.867739 31921 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 LEADER]: Stepping down as leader of term 33
I20260620 23:03:23.867790 31921 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:23.867864 31921 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 33, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.867894 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 34 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:23.867956 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 33 FOLLOWER]: Advancing to term 34
I20260620 23:03:23.867991 31922 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Leader election lost for term 34. Reason: could not achieve majority
I20260620 23:03:23.936357 31920 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 33 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:23.936472 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 33 FOLLOWER]: Advancing to term 34
I20260620 23:03:23.937353 31920 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.937592 31920 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 34 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:23.937819 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:23.937896 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 34: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:23.937848 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 34 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.938603 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 34.
I20260620 23:03:23.938863 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:23.938977 31920 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 FOLLOWER]: Leader election won for term 34
I20260620 23:03:23.939064 31920 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:23.939121 31920 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.939670 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 33 to 34, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 34 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:23.996789 31922 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:23.996896 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 34 FOLLOWER]: Advancing to term 35
I20260620 23:03:23.997735 31922 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:23.997980 31922 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 35 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:23.998265 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 35 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:23.998265 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 35 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:23.998394 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 34 FOLLOWER]: Advancing to term 35
I20260620 23:03:23.999114 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 35 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 35.
I20260620 23:03:23.999336 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 35 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:23.999445 31922 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 FOLLOWER]: Leader election won for term 35
I20260620 23:03:23.999495 31922 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:23.999562 31922 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 33.58, Last appended by leader: 58, Current term: 35, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.000106 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 34 to 35, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 35 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:24.019443 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 35 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 34. Current term is 35. Ops: []
I20260620 23:03:24.019855 31920 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:24.020013 31920 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 LEADER]: Stepping down as leader of term 34
I20260620 23:03:24.020097 31920 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:24.020192 31920 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.59, Last appended by leader: 59, Current term: 34, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.020327 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 34 FOLLOWER]: Advancing to term 35
I20260620 23:03:24.101917 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 35 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:24.102023 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 35 FOLLOWER]: Advancing to term 36
I20260620 23:03:24.102842 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 36 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.103046 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 36 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.103331 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 36 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.103344 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 36 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.103492 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 35 FOLLOWER]: Advancing to term 36
I20260620 23:03:24.104216 31652 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 36 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 36 because replica has last-logged OpId of term: 34 index: 59, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 58.
I20260620 23:03:24.104423 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 36 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:24.104516 31921 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 36 FOLLOWER]: Leader election lost for term 36. Reason: could not achieve majority
I20260620 23:03:24.108810 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 36 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 35. Current term is 36. Ops: []
I20260620 23:03:24.109134 31923 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:24.109227 31803 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 36 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 35. Current term is 36. Ops: []
I20260620 23:03:24.109289 31923 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 34.59 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 58
I20260620 23:03:24.109330 31922 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 LEADER]: Stepping down as leader of term 35
I20260620 23:03:24.109383 31922 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:24.109416 31923 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 59, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:24.109508 31922 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 35.59, Last appended by leader: 59, Current term: 35, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.109601 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 35 FOLLOWER]: Advancing to term 36
I20260620 23:03:24.238528 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 36 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:24.238639 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 36 FOLLOWER]: Advancing to term 37
I20260620 23:03:24.239410 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 37 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.239701 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 37 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.239822 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 37 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.239890 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 36 FOLLOWER]: Advancing to term 37
I20260620 23:03:24.239866 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 37 candidate_status { last_received { term: 33 index: 58 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.239992 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 36 FOLLOWER]: Advancing to term 37
I20260620 23:03:24.240562 31728 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 37 because replica has last-logged OpId of term: 35 index: 59, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 58.
I20260620 23:03:24.240671 31652 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 37 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 37 because replica has last-logged OpId of term: 34 index: 59, which is greater than that of the candidate, which has last-logged OpId of term: 33 index: 58.
I20260620 23:03:24.240851 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 37 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:24.240960 31921 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 37 FOLLOWER]: Leader election lost for term 37. Reason: could not achieve majority
I20260620 23:03:24.265533 31920 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 37 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:24.265637 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 37 FOLLOWER]: Advancing to term 38
I20260620 23:03:24.266469 31920 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.266719 31920 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 38 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:24.266916 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 38 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:24.267000 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 37 FOLLOWER]: Advancing to term 38
I20260620 23:03:24.266952 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 38 candidate_status { last_received { term: 34 index: 59 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.267091 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 37 FOLLOWER]: Advancing to term 38
I20260620 23:03:24.267660 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 38 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 38.
I20260620 23:03:24.267721 31728 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 38 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for term 38 because replica has last-logged OpId of term: 35 index: 59, which is greater than that of the candidate, which has last-logged OpId of term: 34 index: 59.
I20260620 23:03:24.267936 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 38 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:24.268046 31920 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 FOLLOWER]: Leader election won for term 38
I20260620 23:03:24.268138 31920 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:24.268195 31920 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 58, Committed index: 58, Last appended: 34.59, Last appended by leader: 59, Current term: 38, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.268694 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 35 to 38, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 38 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:24.357658 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 38 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 35 index: 59. Preceding OpId from leader: term: 38 index: 60. (index mismatch)
I20260620 23:03:24.357983 31920 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:24.358124 31920 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 35.59 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 58
I20260620 23:03:24.358474 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 58
I20260620 23:03:24.358521 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 35.59
I20260620 23:03:24.358541 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 38 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:24.359565 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 38 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 33 index: 58. Preceding OpId from leader: term: 38 index: 60. (index mismatch)
I20260620 23:03:24.359784 31926 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 60, Last known committed idx: 58, Time since last communication: 0.000s
I20260620 23:03:24.460213 31922 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 38 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:24.460340 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 38 FOLLOWER]: Advancing to term 39
I20260620 23:03:24.461185 31922 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.461534 31922 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 39 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.461604 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:24.461699 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.462006 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 39 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:24.462121 31922 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Leader election lost for term 39. Reason: could not achieve majority
I20260620 23:03:24.467353 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 38. Current term is 39. Ops: []
I20260620 23:03:24.467633 31920 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 38.60, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260620 23:03:24.467757 31920 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 LEADER]: Stepping down as leader of term 38
I20260620 23:03:24.467790 31920 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:24.467862 31920 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 38, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.467952 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 38 FOLLOWER]: Advancing to term 39
I20260620 23:03:24.554600 31924 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 38 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:24.554714 31924 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 38 FOLLOWER]: Advancing to term 39
I20260620 23:03:24.555502 31924 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.555832 31924 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 39 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.555948 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.555960 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 39 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.556106 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 39: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:24.556715 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 39 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 39.
I20260620 23:03:24.556978 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 39 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:24.557094 31924 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 FOLLOWER]: Leader election won for term 39
I20260620 23:03:24.557179 31924 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:24.557240 31924 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 39, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.557780 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 38 to 39, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 39 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:24.583374 31922 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:24.583482 31922 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 39 FOLLOWER]: Advancing to term 40
I20260620 23:03:24.584309 31922 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.584513 31922 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 40 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.584750 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 40 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.584837 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 40 candidate_status { last_received { term: 38 index: 60 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:24.584918 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 39 FOLLOWER]: Advancing to term 40
I20260620 23:03:24.585588 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 40 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 40.
I20260620 23:03:24.585773 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 40 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:24.585883 31922 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 FOLLOWER]: Leader election won for term 40
I20260620 23:03:24.585969 31922 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:24.586045 31922 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 38.60, Last appended by leader: 60, Current term: 40, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.586535 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 39 to 40, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 40 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:24.668510 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 40 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 39. Current term is 40. Ops: []
I20260620 23:03:24.668872 31924 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260620 23:03:24.669042 31924 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 LEADER]: Stepping down as leader of term 39
I20260620 23:03:24.669081 31924 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:24.669157 31924 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 60, Committed index: 60, Last appended: 39.61, Last appended by leader: 61, Current term: 39, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.669262 31924 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 39 FOLLOWER]: Advancing to term 40
I20260620 23:03:24.700479 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 40 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 39 index: 61. Preceding OpId from leader: term: 40 index: 61. (term mismatch)
I20260620 23:03:24.700558 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 60
I20260620 23:03:24.700573 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 39.61
I20260620 23:03:24.700589 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 40 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:24.700826 31922 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260620 23:03:24.701732 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 40 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 38 index: 60. Preceding OpId from leader: term: 40 index: 61. (index mismatch)
I20260620 23:03:24.701939 31922 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 61, Last known committed idx: 60, Time since last communication: 0.000s
I20260620 23:03:24.756354 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:24.802525 31920 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 40 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:24.802634 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 40 FOLLOWER]: Advancing to term 41
I20260620 23:03:24.803315 31920 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.803515 31920 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 41 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:24.803735 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:24.803738 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.804021 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 41 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:24.804131 31920 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Leader election lost for term 41. Reason: could not achieve majority
I20260620 23:03:24.805532 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 40. Current term is 41. Ops: []
I20260620 23:03:24.805979 31922 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 40.61, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260620 23:03:24.806115 31919 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 LEADER]: Stepping down as leader of term 40
I20260620 23:03:24.806170 31919 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:24.806228 31919 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.61, Last appended by leader: 61, Current term: 40, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.806336 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 40 FOLLOWER]: Advancing to term 41
I20260620 23:03:24.894402 31924 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 40 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:24.894527 31924 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 40 FOLLOWER]: Advancing to term 41
I20260620 23:03:24.895265 31924 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.895506 31924 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 41 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:24.895714 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:24.895784 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 41: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:24.895749 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 41 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.896554 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 41 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 41.
I20260620 23:03:24.896790 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 41 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:24.896898 31924 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 FOLLOWER]: Leader election won for term 41
I20260620 23:03:24.896958 31924 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:24.897020 31924 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.61, Last appended by leader: 61, Current term: 41, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.897580 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 40 to 41, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 41 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:24.925763 31920 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:24.925951 31920 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 41 FOLLOWER]: Advancing to term 42
I20260620 23:03:24.926918 31920 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.927109 31920 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 42 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:24.927443 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 42 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:24.927455 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 42 candidate_status { last_received { term: 40 index: 61 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:24.927598 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 41 FOLLOWER]: Advancing to term 42
I20260620 23:03:24.928321 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 42 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 42.
I20260620 23:03:24.928536 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 42 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:24.928651 31920 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 FOLLOWER]: Leader election won for term 42
I20260620 23:03:24.928709 31920 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:24.928805 31920 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 40.61, Last appended by leader: 61, Current term: 42, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.929337 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 41 to 42, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 42 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:24.994345 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 42 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 41. Current term is 42. Ops: []
I20260620 23:03:24.994699 31924 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260620 23:03:24.994891 31924 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 LEADER]: Stepping down as leader of term 41
I20260620 23:03:24.994942 31924 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:24.995019 31924 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 61, Committed index: 61, Last appended: 41.62, Last appended by leader: 62, Current term: 41, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:24.995119 31924 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 41 FOLLOWER]: Advancing to term 42
I20260620 23:03:25.015194 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 42 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 40 index: 61. Preceding OpId from leader: term: 42 index: 62. (index mismatch)
I20260620 23:03:25.015540 31920 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260620 23:03:25.016816 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 42 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 41 index: 62. Preceding OpId from leader: term: 42 index: 62. (term mismatch)
I20260620 23:03:25.016868 31803 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 61
I20260620 23:03:25.016888 31803 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 41.62
I20260620 23:03:25.016911 31803 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 42 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:25.017110 31920 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 62, Last known committed idx: 61, Time since last communication: 0.000s
I20260620 23:03:25.194741 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 42 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:25.194988 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 42 FOLLOWER]: Advancing to term 43
I20260620 23:03:25.195675 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.195961 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 43 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:25.196190 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 43 candidate_status { last_received { term: 42 index: 62 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:25.196257 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 43 candidate_status { last_received { term: 42 index: 62 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:25.196565 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 43 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:25.196698 31919 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Leader election lost for term 43. Reason: could not achieve majority
I20260620 23:03:25.205538 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 42. Current term is 43. Ops: []
I20260620 23:03:25.205945 31920 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 42.62, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260620 23:03:25.206174 31928 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 LEADER]: Stepping down as leader of term 42
I20260620 23:03:25.206223 31928 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:25.206310 31928 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 42.62, Last appended by leader: 62, Current term: 42, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.206405 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 42 FOLLOWER]: Advancing to term 43
I20260620 23:03:25.227154 31924 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 42 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:25.227250 31924 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 42 FOLLOWER]: Advancing to term 43
I20260620 23:03:25.227960 31924 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.228156 31924 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 43 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:25.228368 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 43 candidate_status { last_received { term: 42 index: 62 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:25.228386 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 43 candidate_status { last_received { term: 42 index: 62 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:25.228488 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 43: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:25.229034 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 43 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 43.
I20260620 23:03:25.229226 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 43 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:25.229327 31924 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 FOLLOWER]: Leader election won for term 43
I20260620 23:03:25.229373 31924 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:25.229426 31924 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 62, Committed index: 62, Last appended: 42.62, Last appended by leader: 62, Current term: 43, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.229944 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 42 to 43, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 43 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:25.309545 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 42 index: 62. Preceding OpId from leader: term: 43 index: 63. (index mismatch)
I20260620 23:03:25.309875 31924 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260620 23:03:25.311120 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 43 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 42 index: 62. Preceding OpId from leader: term: 43 index: 63. (index mismatch)
I20260620 23:03:25.311300 31929 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 63, Last known committed idx: 62, Time since last communication: 0.000s
I20260620 23:03:25.432392 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 43 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:25.432523 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 43 FOLLOWER]: Advancing to term 44
I20260620 23:03:25.433368 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.433744 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 44 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:25.433915 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:25.434062 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:25.434360 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 44 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:25.434544 31928 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Leader election lost for term 44. Reason: could not achieve majority
I20260620 23:03:25.435420 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 43. Current term is 44. Ops: []
I20260620 23:03:25.435817 31921 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 43.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260620 23:03:25.435945 31921 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 LEADER]: Stepping down as leader of term 43
I20260620 23:03:25.435981 31921 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:25.436084 31921 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 43, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.436169 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 43 FOLLOWER]: Advancing to term 44
I20260620 23:03:25.489902 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:25.490006 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 43 FOLLOWER]: Advancing to term 44
I20260620 23:03:25.490756 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.490962 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 44 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:25.491289 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:25.491289 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 44 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:25.491451 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 44: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:25.492134 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 44 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 44.
I20260620 23:03:25.492344 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 44 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:25.492479 31919 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 FOLLOWER]: Leader election won for term 44
I20260620 23:03:25.492627 31919 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:25.492723 31919 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 44, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.493366 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 43 to 44, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 44 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:25.573072 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:25.573190 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 44 FOLLOWER]: Advancing to term 45
I20260620 23:03:25.573980 31803 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 44 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 44 index: 64. (index mismatch)
I20260620 23:03:25.574232 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.574402 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 45 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:25.574486 31919 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260620 23:03:25.574545 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 45 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:25.574620 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 45 candidate_status { last_received { term: 43 index: 63 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:25.574628 31803 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 44 FOLLOWER]: Advancing to term 45
I20260620 23:03:25.575383 31803 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 45 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 45.
I20260620 23:03:25.575525 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 45 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 44. Current term is 45. Ops: [44.64-44.64]
I20260620 23:03:25.575614 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 45 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:25.575742 31928 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 FOLLOWER]: Leader election won for term 45
I20260620 23:03:25.575769 31919 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 43.63, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260620 23:03:25.575874 31919 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 LEADER]: Stepping down as leader of term 44
I20260620 23:03:25.575835 31928 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:25.575924 31919 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:25.575964 31928 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 43.63, Last appended by leader: 63, Current term: 45, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.575970 31919 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 63, Committed index: 63, Last appended: 44.64, Last appended by leader: 64, Current term: 44, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.576152 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 44 FOLLOWER]: Advancing to term 45
I20260620 23:03:25.576633 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 44 to 45, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 45 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:25.668679 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 45 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 44 index: 64. Preceding OpId from leader: term: 45 index: 64. (term mismatch)
I20260620 23:03:25.668789 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 63
I20260620 23:03:25.668810 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 44.64
I20260620 23:03:25.668915 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 45 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:25.669225 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260620 23:03:25.670463 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 45 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 43 index: 63. Preceding OpId from leader: term: 45 index: 64. (index mismatch)
I20260620 23:03:25.670758 31920 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 64, Last known committed idx: 63, Time since last communication: 0.000s
I20260620 23:03:25.756655 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:25.865134 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 45 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:25.865242 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 45 FOLLOWER]: Advancing to term 46
I20260620 23:03:25.865995 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.866184 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 46 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:25.866560 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:25.866567 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:25.866914 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 46 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:25.867010 31921 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Leader election lost for term 46. Reason: could not achieve majority
I20260620 23:03:25.885438 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 45. Current term is 46. Ops: []
I20260620 23:03:25.885748 31931 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 45.64, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260620 23:03:25.885926 31928 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 LEADER]: Stepping down as leader of term 45
I20260620 23:03:25.885977 31928 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:25.886045 31928 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 45, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.886135 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 45 FOLLOWER]: Advancing to term 46
I20260620 23:03:25.952472 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 45 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:25.952572 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 45 FOLLOWER]: Advancing to term 46
I20260620 23:03:25.953209 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.953416 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 46 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:25.953636 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:25.953775 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 46: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:25.953660 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 46 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:25.954413 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 46 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 46.
I20260620 23:03:25.954604 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 46 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:25.954722 31919 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 FOLLOWER]: Leader election won for term 46
I20260620 23:03:25.954836 31919 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:25.954898 31919 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 46, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.955314 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 45 to 46, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 46 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:25.998728 31921 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:25.998896 31921 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 46 FOLLOWER]: Advancing to term 47
I20260620 23:03:25.999672 31921 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:25.999897 31921 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 47 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:26.000212 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 47 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:26.000247 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 47 candidate_status { last_received { term: 45 index: 64 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:26.000320 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 46 FOLLOWER]: Advancing to term 47
I20260620 23:03:26.000980 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 47 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 47.
I20260620 23:03:26.001247 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 47 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:26.001406 31921 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 FOLLOWER]: Leader election won for term 47
I20260620 23:03:26.001494 31921 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:26.001561 31921 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 45.64, Last appended by leader: 64, Current term: 47, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.002120 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 46 to 47, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 47 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:26.056141 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 46. Current term is 47. Ops: []
I20260620 23:03:26.056464 31919 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260620 23:03:26.056576 31919 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 47.65 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 64
I20260620 23:03:26.056599 31919 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 LEADER]: Stepping down as leader of term 46
I20260620 23:03:26.056613 31919 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:26.056695 31919 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 64, Committed index: 64, Last appended: 46.65, Last appended by leader: 65, Current term: 46, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.056766 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 46 FOLLOWER]: Advancing to term 47
I20260620 23:03:26.082099 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 47 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 46 index: 65. Preceding OpId from leader: term: 47 index: 65. (term mismatch)
I20260620 23:03:26.082197 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 64
I20260620 23:03:26.082213 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 46.65
I20260620 23:03:26.082232 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 47 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:26.082621 31921 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260620 23:03:26.083900 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 47 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 45 index: 64. Preceding OpId from leader: term: 47 index: 65. (index mismatch)
I20260620 23:03:26.084364 31921 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 65, Last known committed idx: 64, Time since last communication: 0.000s
I20260620 23:03:26.359664 31919 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 47 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:26.359951 31919 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 47 FOLLOWER]: Advancing to term 48
I20260620 23:03:26.360881 31919 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.361105 31919 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 48 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:26.361406 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:26.361406 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:26.361835 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 48 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:26.362020 31919 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Leader election lost for term 48. Reason: could not achieve majority
I20260620 23:03:26.368330 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 47 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:26.368433 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 47 FOLLOWER]: Advancing to term 48
I20260620 23:03:26.369217 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 47. Current term is 48. Ops: []
I20260620 23:03:26.369444 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.369465 31932 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 47.65, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260620 23:03:26.369642 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 48 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:26.369663 31932 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 LEADER]: Stepping down as leader of term 47
I20260620 23:03:26.369702 31932 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:26.369763 31932 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 47, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.369803 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:26.369805 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 48 candidate_status { last_received { term: 47 index: 65 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:26.369882 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 48: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:26.369881 31932 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 47 FOLLOWER]: Advancing to term 48
I20260620 23:03:26.371340 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 48 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 48.
I20260620 23:03:26.371536 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 48 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:26.371637 31928 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 FOLLOWER]: Leader election won for term 48
I20260620 23:03:26.371682 31928 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:26.371731 31928 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 65, Committed index: 65, Last appended: 47.65, Last appended by leader: 65, Current term: 48, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.372268 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 47 to 48, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 48 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:26.451352 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 48 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 47 index: 65. Preceding OpId from leader: term: 48 index: 66. (index mismatch)
I20260620 23:03:26.451752 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260620 23:03:26.453182 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 47 index: 65. Preceding OpId from leader: term: 48 index: 66. (index mismatch)
I20260620 23:03:26.453373 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 66, Last known committed idx: 65, Time since last communication: 0.000s
I20260620 23:03:26.757000 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:26.905472 31932 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 48 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:26.905576 31932 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 48 FOLLOWER]: Advancing to term 49
I20260620 23:03:26.906428 31932 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.906642 31932 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 49 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:26.906894 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:26.906908 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:26.907176 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 49 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:26.907287 31932 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Leader election lost for term 49. Reason: could not achieve majority
I20260620 23:03:26.925580 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 48. Current term is 49. Ops: []
I20260620 23:03:26.925910 31928 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 48.66, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260620 23:03:26.926059 31928 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 LEADER]: Stepping down as leader of term 48
I20260620 23:03:26.926082 31928 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:26.926169 31928 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 48, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.926278 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 48 FOLLOWER]: Advancing to term 49
I20260620 23:03:26.977617 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:26.977725 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 48 FOLLOWER]: Advancing to term 49
I20260620 23:03:26.978633 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.978993 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 49 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:26.979228 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:26.979238 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 49 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:26.979363 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 49: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:26.980047 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 49 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 49.
I20260620 23:03:26.980301 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 49 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:26.980420 31933 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 FOLLOWER]: Leader election won for term 49
I20260620 23:03:26.980566 31933 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:26.980640 31933 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 49, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:26.981190 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 48 to 49, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 49 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:27.015947 31932 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:27.016050 31932 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 49 FOLLOWER]: Advancing to term 50
I20260620 23:03:27.016798 31932 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.017002 31932 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 50 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:27.017241 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 50 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:27.017247 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 50 candidate_status { last_received { term: 48 index: 66 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:27.017360 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 49 FOLLOWER]: Advancing to term 50
I20260620 23:03:27.018033 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 50 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 50.
I20260620 23:03:27.018204 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 50 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:27.018392 31932 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 FOLLOWER]: Leader election won for term 50
I20260620 23:03:27.018616 31932 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:27.018692 31932 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 48.66, Last appended by leader: 66, Current term: 50, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.019167 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 49 to 50, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 50 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:27.095569 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 50 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 49. Current term is 50. Ops: []
I20260620 23:03:27.095927 31933 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260620 23:03:27.096135 31934 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 LEADER]: Stepping down as leader of term 49
I20260620 23:03:27.096182 31934 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:27.096169 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 49. Current term is 50. Ops: []
I20260620 23:03:27.096336 31934 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 66, Committed index: 66, Last appended: 49.67, Last appended by leader: 67, Current term: 49, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.096434 31934 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 49 FOLLOWER]: Advancing to term 50
I20260620 23:03:27.124239 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 50 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 49 index: 67. Preceding OpId from leader: term: 50 index: 67. (term mismatch)
I20260620 23:03:27.124320 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 66
I20260620 23:03:27.124334 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 49.67
I20260620 23:03:27.124351 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 50 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:27.124639 31932 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260620 23:03:27.126173 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 50 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 48 index: 66. Preceding OpId from leader: term: 50 index: 67. (index mismatch)
I20260620 23:03:27.126390 31938 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 67, Last known committed idx: 66, Time since last communication: 0.000s
I20260620 23:03:27.227679 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 50 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:27.227847 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 50 FOLLOWER]: Advancing to term 51
I20260620 23:03:27.228658 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.228888 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 51 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:27.229138 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:27.229138 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:27.229434 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 51 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:27.229590 31928 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Leader election lost for term 51. Reason: could not achieve majority
I20260620 23:03:27.232631 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 50. Current term is 51. Ops: []
I20260620 23:03:27.232857 31932 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 50.67, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260620 23:03:27.233033 31938 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 LEADER]: Stepping down as leader of term 50
I20260620 23:03:27.233078 31938 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:27.233158 31938 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 50, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.233253 31938 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 50 FOLLOWER]: Advancing to term 51
I20260620 23:03:27.322485 31934 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 50 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:27.322585 31934 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 50 FOLLOWER]: Advancing to term 51
I20260620 23:03:27.323269 31934 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.323501 31934 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 51 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:27.323705 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:27.323709 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 51 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:27.323886 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 51: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:27.324457 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 51 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 51.
I20260620 23:03:27.324663 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 51 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:27.324769 31934 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 FOLLOWER]: Leader election won for term 51
I20260620 23:03:27.324834 31934 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:27.324890 31934 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 51, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.325385 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 50 to 51, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 51 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:27.331153 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:27.331229 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 51 FOLLOWER]: Advancing to term 52
I20260620 23:03:27.331892 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.332140 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 52 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:27.332337 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 52 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:27.332346 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 52 candidate_status { last_received { term: 50 index: 67 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:27.332434 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 51 FOLLOWER]: Advancing to term 52
I20260620 23:03:27.333073 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 52 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 52.
I20260620 23:03:27.333356 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 52 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:27.333519 31928 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 FOLLOWER]: Leader election won for term 52
I20260620 23:03:27.333590 31928 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:27.333642 31928 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 50.67, Last appended by leader: 67, Current term: 52, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.334138 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 51 to 52, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 52 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:27.408567 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 51. Current term is 52. Ops: []
I20260620 23:03:27.408922 31934 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260620 23:03:27.409119 31934 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 52.68 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 67
I20260620 23:03:27.409171 31933 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 LEADER]: Stepping down as leader of term 51
I20260620 23:03:27.409235 31933 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:27.409301 31933 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 67, Committed index: 67, Last appended: 51.68, Last appended by leader: 68, Current term: 51, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.409379 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 51 FOLLOWER]: Advancing to term 52
I20260620 23:03:27.447288 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 52 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 51 index: 68. Preceding OpId from leader: term: 52 index: 68. (term mismatch)
I20260620 23:03:27.447402 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 67
I20260620 23:03:27.447430 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 51.68
I20260620 23:03:27.447453 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 52 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:27.447741 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260620 23:03:27.448956 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 52 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 50 index: 67. Preceding OpId from leader: term: 52 index: 68. (index mismatch)
I20260620 23:03:27.449137 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 68, Last known committed idx: 67, Time since last communication: 0.000s
I20260620 23:03:27.549537 31932 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 52 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:27.549647 31932 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 52 FOLLOWER]: Advancing to term 53
I20260620 23:03:27.550448 31932 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.550618 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 52. Current term is 53. Ops: []
I20260620 23:03:27.550653 31932 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 53 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:27.550823 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 53 candidate_status { last_received { term: 52 index: 68 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:27.550895 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 52 FOLLOWER]: Advancing to term 53
I20260620 23:03:27.550892 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 53 candidate_status { last_received { term: 52 index: 68 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:27.551179 31928 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 52.68, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260620 23:03:27.551267 31928 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 LEADER]: Stepping down as leader of term 52
I20260620 23:03:27.551290 31928 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:27.551329 31928 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 52.68, Last appended by leader: 68, Current term: 52, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.551406 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 52 FOLLOWER]: Advancing to term 53
I20260620 23:03:27.551725 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 53 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 53.
I20260620 23:03:27.551915 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 53 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:27.552049 31932 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 FOLLOWER]: Leader election won for term 53
I20260620 23:03:27.552150 31932 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:27.552198 31932 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 68, Committed index: 68, Last appended: 52.68, Last appended by leader: 68, Current term: 53, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.552642 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 52 to 53, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 53 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:27.649600 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 53 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 52 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260620 23:03:27.649935 31932 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260620 23:03:27.651117 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 53 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 52 index: 68. Preceding OpId from leader: term: 53 index: 69. (index mismatch)
I20260620 23:03:27.651449 31939 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 69, Last known committed idx: 68, Time since last communication: 0.000s
I20260620 23:03:27.757311 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:27.832213 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 53 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:27.832312 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 53 FOLLOWER]: Advancing to term 54
I20260620 23:03:27.833056 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.833258 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 54 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:27.833493 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:27.833531 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:27.833789 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 54 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:27.833948 31933 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Leader election lost for term 54. Reason: could not achieve majority
I20260620 23:03:27.850373 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 53. Current term is 54. Ops: []
I20260620 23:03:27.850664 31939 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 53.69, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260620 23:03:27.850808 31938 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 LEADER]: Stepping down as leader of term 53
I20260620 23:03:27.850854 31938 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:27.850898 31938 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 53, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.850976 31938 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 53 FOLLOWER]: Advancing to term 54
I20260620 23:03:27.857146 31928 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 53 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:27.857218 31928 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 53 FOLLOWER]: Advancing to term 54
I20260620 23:03:27.857813 31928 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.857976 31928 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 54 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:27.858158 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:27.858184 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 54 candidate_status { last_received { term: 53 index: 69 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:27.858309 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 54: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:27.858780 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 54 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 54.
I20260620 23:03:27.858986 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 54 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:27.859082 31928 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 FOLLOWER]: Leader election won for term 54
I20260620 23:03:27.859135 31928 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:27.859189 31928 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 69, Committed index: 69, Last appended: 53.69, Last appended by leader: 69, Current term: 54, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:27.859628 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 53 to 54, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 54 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:27.936151 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 54 index: 70. (index mismatch)
I20260620 23:03:27.936482 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260620 23:03:27.937708 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 54 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 53 index: 69. Preceding OpId from leader: term: 54 index: 70. (index mismatch)
I20260620 23:03:27.937911 31928 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 70, Last known committed idx: 69, Time since last communication: 0.000s
I20260620 23:03:28.131980 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:28.132157 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 54 FOLLOWER]: Advancing to term 55
I20260620 23:03:28.132856 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.133075 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 55 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.133316 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.133316 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.133642 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 55 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:28.133737 31933 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Leader election lost for term 55. Reason: could not achieve majority
I20260620 23:03:28.140472 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 54. Current term is 55. Ops: []
I20260620 23:03:28.140774 31940 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 54.70, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260620 23:03:28.140908 31940 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 LEADER]: Stepping down as leader of term 54
I20260620 23:03:28.140928 31940 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:28.141180 31940 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 54.70, Last appended by leader: 70, Current term: 54, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.141319 31940 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 54 FOLLOWER]: Advancing to term 55
I20260620 23:03:28.147162 31938 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 54 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:28.147229 31938 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 54 FOLLOWER]: Advancing to term 55
I20260620 23:03:28.147862 31938 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.148144 31938 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 55 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.148331 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:28.148350 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 55 candidate_status { last_received { term: 54 index: 70 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.148440 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 55: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:28.149037 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 55 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 55.
I20260620 23:03:28.149214 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 55 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:28.149338 31938 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 FOLLOWER]: Leader election won for term 55
I20260620 23:03:28.149402 31938 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:28.149456 31938 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 70, Committed index: 70, Last appended: 54.70, Last appended by leader: 70, Current term: 55, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.149901 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 54 to 55, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 55 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:28.240828 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 54 index: 70. Preceding OpId from leader: term: 55 index: 71. (index mismatch)
I20260620 23:03:28.241173 31938 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260620 23:03:28.242429 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 55 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 54 index: 70. Preceding OpId from leader: term: 55 index: 71. (index mismatch)
I20260620 23:03:28.242642 31939 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 71, Last known committed idx: 70, Time since last communication: 0.000s
I20260620 23:03:28.444422 31931 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 55 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:28.444532 31931 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 55 FOLLOWER]: Advancing to term 56
I20260620 23:03:28.445356 31931 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.445554 31931 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 56 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:28.445832 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 56 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:28.445864 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 56 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.446224 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 56 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:28.446359 31931 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Leader election lost for term 56. Reason: could not achieve majority
I20260620 23:03:28.457870 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 55. Current term is 56. Ops: []
I20260620 23:03:28.458185 31932 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 55.71, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260620 23:03:28.458374 31939 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 LEADER]: Stepping down as leader of term 55
I20260620 23:03:28.458428 31939 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:28.458529 31939 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 55.71, Last appended by leader: 71, Current term: 55, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.458626 31939 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 55 FOLLOWER]: Advancing to term 56
I20260620 23:03:28.507216 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:28.507371 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 55 FOLLOWER]: Advancing to term 56
I20260620 23:03:28.508276 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.508526 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 56 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.508786 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 56 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.508934 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 56: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:28.508766 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 56 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.509581 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 56 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 56.
I20260620 23:03:28.509853 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 56 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:28.509982 31933 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 FOLLOWER]: Leader election won for term 56
I20260620 23:03:28.510145 31933 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:28.510200 31933 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 55.71, Last appended by leader: 71, Current term: 56, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.510756 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 55 to 56, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 56 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:28.548951 31931 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:28.549086 31931 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 56 FOLLOWER]: Advancing to term 57
I20260620 23:03:28.549772 31931 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.550006 31931 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 57 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:28.550235 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 57 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:28.550278 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 57 candidate_status { last_received { term: 55 index: 71 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.550439 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 56 FOLLOWER]: Advancing to term 57
I20260620 23:03:28.551025 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 57 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 57.
I20260620 23:03:28.551220 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 57 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:28.551317 31931 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 FOLLOWER]: Leader election won for term 57
I20260620 23:03:28.551390 31931 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:28.551467 31931 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 55.71, Last appended by leader: 71, Current term: 57, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.551959 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 56 to 57, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 57 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:28.609501 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 56. Current term is 57. Ops: []
I20260620 23:03:28.609788 31933 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260620 23:03:28.609908 31933 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 57.72 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 71
I20260620 23:03:28.609941 31933 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 LEADER]: Stepping down as leader of term 56
I20260620 23:03:28.610013 31933 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:28.610075 31933 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 71, Committed index: 71, Last appended: 56.72, Last appended by leader: 72, Current term: 56, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.610178 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 56 FOLLOWER]: Advancing to term 57
I20260620 23:03:28.649783 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 57 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 56 index: 72. Preceding OpId from leader: term: 57 index: 72. (term mismatch)
I20260620 23:03:28.649907 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 71
I20260620 23:03:28.649931 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 56.72
I20260620 23:03:28.649957 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 57 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:28.650240 31931 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260620 23:03:28.651525 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 57 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 55 index: 71. Preceding OpId from leader: term: 57 index: 72. (index mismatch)
I20260620 23:03:28.651726 31940 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 72, Last known committed idx: 71, Time since last communication: 0.000s
I20260620 23:03:28.757547 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:28.859088 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 57 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:28.859220 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 57 FOLLOWER]: Advancing to term 58
I20260620 23:03:28.859920 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.860196 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 58 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.860387 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 58 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.860387 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 58 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.860677 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 58 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:28.860757 31933 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Leader election lost for term 58. Reason: could not achieve majority
I20260620 23:03:28.860859 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 57. Current term is 58. Ops: []
I20260620 23:03:28.861076 31931 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 57.72, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260620 23:03:28.861207 31942 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 LEADER]: Stepping down as leader of term 57
I20260620 23:03:28.861246 31942 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:28.861332 31942 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 57.72, Last appended by leader: 72, Current term: 57, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.861423 31942 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 57 FOLLOWER]: Advancing to term 58
I20260620 23:03:28.925454 31939 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 57 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:28.925560 31939 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 57 FOLLOWER]: Advancing to term 58
I20260620 23:03:28.926266 31939 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.926477 31939 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 58 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.926698 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 58 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:28.926833 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 58: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:28.926718 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 58 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.927480 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 58 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 58.
I20260620 23:03:28.927673 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 58 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:28.927779 31939 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 FOLLOWER]: Leader election won for term 58
I20260620 23:03:28.927829 31939 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:28.927875 31939 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 57.72, Last appended by leader: 72, Current term: 58, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.928390 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 57 to 58, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 58 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:28.964445 31933 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:28.964545 31933 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 58 FOLLOWER]: Advancing to term 59
I20260620 23:03:28.965301 31933 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.965497 31933 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 59 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:28.965749 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 59 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:28.965822 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 58 FOLLOWER]: Advancing to term 59
I20260620 23:03:28.965754 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 59 candidate_status { last_received { term: 57 index: 72 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:28.966368 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 59 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 59.
I20260620 23:03:28.966529 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 59 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:28.966653 31933 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 FOLLOWER]: Leader election won for term 59
I20260620 23:03:28.966732 31933 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:28.966785 31933 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 57.72, Last appended by leader: 72, Current term: 59, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:28.967339 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 58 to 59, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 59 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:29.026340 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 59 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 58. Current term is 59. Ops: []
I20260620 23:03:29.026666 31939 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260620 23:03:29.026803 31939 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 LEADER]: Stepping down as leader of term 58
I20260620 23:03:29.026837 31939 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:29.026904 31939 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 72, Committed index: 72, Last appended: 58.73, Last appended by leader: 73, Current term: 58, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.027000 31939 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 58 FOLLOWER]: Advancing to term 59
I20260620 23:03:29.044967 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 59 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 58 index: 73. Preceding OpId from leader: term: 59 index: 73. (term mismatch)
I20260620 23:03:29.045066 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 72
I20260620 23:03:29.045089 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 58.73
I20260620 23:03:29.045120 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 59 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:29.045492 31941 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260620 23:03:29.045814 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 59 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 57 index: 72. Preceding OpId from leader: term: 59 index: 73. (index mismatch)
I20260620 23:03:29.046070 31941 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 73, Last known committed idx: 72, Time since last communication: 0.000s
I20260620 23:03:29.252758 31939 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 59 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:29.252871 31939 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 59 FOLLOWER]: Advancing to term 60
I20260620 23:03:29.253568 31939 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.253705 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 59. Current term is 60. Ops: []
I20260620 23:03:29.253841 31939 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 60 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.253893 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 60 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.253938 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 60 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.254022 31943 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 59.73, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260620 23:03:29.254139 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 60 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.254267 31943 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 LEADER]: Stepping down as leader of term 59
I20260620 23:03:29.254307 31939 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Leader election lost for term 60. Reason: could not achieve majority
I20260620 23:03:29.254312 31943 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:29.254446 31943 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 59.73, Last appended by leader: 73, Current term: 59, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.254541 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 59 FOLLOWER]: Advancing to term 60
I20260620 23:03:29.326002 31942 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 59 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:29.326110 31942 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 59 FOLLOWER]: Advancing to term 60
I20260620 23:03:29.326819 31942 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.327065 31942 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 60 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:29.327303 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 60 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:29.327322 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 60 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.327397 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 60: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:29.328130 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 60 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 60.
I20260620 23:03:29.328338 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 60 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:29.328500 31942 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 FOLLOWER]: Leader election won for term 60
I20260620 23:03:29.328583 31942 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:29.328645 31942 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 59.73, Last appended by leader: 73, Current term: 60, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.329152 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 59 to 60, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 60 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:29.379925 31939 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:29.380035 31939 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 60 FOLLOWER]: Advancing to term 61
I20260620 23:03:29.380728 31939 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.380923 31939 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 61 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.381192 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 61 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.381309 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 60 FOLLOWER]: Advancing to term 61
I20260620 23:03:29.381201 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 61 candidate_status { last_received { term: 59 index: 73 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.381942 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 61 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 61.
I20260620 23:03:29.382205 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 61 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.382308 31939 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 FOLLOWER]: Leader election won for term 61
I20260620 23:03:29.382360 31939 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:29.382422 31939 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 59.73, Last appended by leader: 73, Current term: 61, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.382896 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 60 to 61, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 61 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:29.406971 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 61 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 60. Current term is 61. Ops: []
I20260620 23:03:29.407312 31942 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260620 23:03:29.407446 31942 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 LEADER]: Stepping down as leader of term 60
I20260620 23:03:29.407465 31942 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:29.407562 31942 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 73, Committed index: 73, Last appended: 60.74, Last appended by leader: 74, Current term: 60, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.407644 31942 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 60 FOLLOWER]: Advancing to term 61
I20260620 23:03:29.470911 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 61 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 59 index: 73. Preceding OpId from leader: term: 61 index: 74. (index mismatch)
I20260620 23:03:29.471273 31939 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260620 23:03:29.472498 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 61 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 60 index: 74. Preceding OpId from leader: term: 61 index: 74. (term mismatch)
I20260620 23:03:29.472560 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 73
I20260620 23:03:29.472586 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 60.74
I20260620 23:03:29.472615 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 61 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:29.472800 31939 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 74, Last known committed idx: 73, Time since last communication: 0.000s
I20260620 23:03:29.572940 31943 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 61 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:29.573058 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 61 FOLLOWER]: Advancing to term 62
I20260620 23:03:29.573800 31943 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.574002 31943 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 62 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.574301 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 62 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.574297 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 62 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:29.574571 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 62 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.574674 31943 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Leader election lost for term 62. Reason: could not achieve majority
I20260620 23:03:29.590179 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 61. Current term is 62. Ops: []
I20260620 23:03:29.590492 31944 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 61.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:29.590620 31944 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 LEADER]: Stepping down as leader of term 61
I20260620 23:03:29.590659 31944 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:29.590725 31944 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 61.74, Last appended by leader: 74, Current term: 61, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.590827 31944 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 61 FOLLOWER]: Advancing to term 62
I20260620 23:03:29.664189 31931 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 61 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:29.664284 31931 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 61 FOLLOWER]: Advancing to term 62
I20260620 23:03:29.665011 31931 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.665194 31931 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 62 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:29.665441 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 62 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:29.665510 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 62 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.665566 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 62: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:29.666118 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 62 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 62.
I20260620 23:03:29.666298 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 62 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:29.666409 31931 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 FOLLOWER]: Leader election won for term 62
I20260620 23:03:29.666466 31931 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:29.666528 31931 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 61.74, Last appended by leader: 74, Current term: 62, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.667006 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 61 to 62, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 62 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:29.691325 31943 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:29.691429 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 62 FOLLOWER]: Advancing to term 63
I20260620 23:03:29.692176 31943 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.692389 31943 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 63 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.692642 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 63 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.692642 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 63 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:29.692780 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 62 FOLLOWER]: Advancing to term 63
I20260620 23:03:29.693397 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 63 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 63.
I20260620 23:03:29.693598 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 63 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.693739 31943 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 FOLLOWER]: Leader election won for term 63
I20260620 23:03:29.693862 31943 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:29.693933 31943 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 61.74, Last appended by leader: 74, Current term: 63, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.694415 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 62 to 63, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 63 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:29.757848 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:29.767756 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 LEADER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 62. Current term is 63. Ops: []
I20260620 23:03:29.768119 31931 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:29.768271 31931 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 63.75 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 74
I20260620 23:03:29.768306 31942 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 LEADER]: Stepping down as leader of term 62
I20260620 23:03:29.768385 31942 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:29.768523 31942 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 74, Committed index: 74, Last appended: 62.75, Last appended by leader: 75, Current term: 62, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.768642 31942 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 62 FOLLOWER]: Advancing to term 63
I20260620 23:03:29.816475 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 63 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 62 index: 75. Preceding OpId from leader: term: 63 index: 75. (term mismatch)
I20260620 23:03:29.816601 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 74
I20260620 23:03:29.816627 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 62.75
I20260620 23:03:29.816668 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 63 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:29.816812 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 63 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 61 index: 74. Preceding OpId from leader: term: 63 index: 75. (index mismatch)
I20260620 23:03:29.816941 31943 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:29.816996 31944 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 63 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:29.817090 31944 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 63 FOLLOWER]: Advancing to term 64
I20260620 23:03:29.817157 31941 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:29.818264 31944 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 64 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.818460 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 64 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 63. Current term is 64. Ops: [63.75-63.75]
I20260620 23:03:29.818601 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 64 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.818589 31944 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 64 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.818567 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 64 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.818703 31941 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 61.74, Next index: 75, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:29.818831 31943 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 LEADER]: Stepping down as leader of term 63
I20260620 23:03:29.818890 31943 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:29.818847 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 64 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.818951 31943 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 63.75, Last appended by leader: 75, Current term: 63, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.819022 31944 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 64 FOLLOWER]: Leader election lost for term 64. Reason: could not achieve majority
I20260620 23:03:29.819052 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 63 FOLLOWER]: Advancing to term 64
I20260620 23:03:29.967712 31944 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 64 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:29.967842 31944 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 64 FOLLOWER]: Advancing to term 65
I20260620 23:03:29.968672 31944 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 65 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.968889 31944 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 65 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:29.969141 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 65 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.969141 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 65 candidate_status { last_received { term: 61 index: 74 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:29.969252 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 64 FOLLOWER]: Advancing to term 65
I20260620 23:03:29.969264 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 63 FOLLOWER]: Advancing to term 65
I20260620 23:03:29.969939 31652 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 65 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 65 because replica has last-logged OpId of term: 63 index: 75, which is greater than that of the candidate, which has last-logged OpId of term: 61 index: 74.
I20260620 23:03:29.969939 31728 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 65 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 65 because replica has last-logged OpId of term: 63 index: 75, which is greater than that of the candidate, which has last-logged OpId of term: 61 index: 74.
I20260620 23:03:29.970189 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 65 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:29.970266 31944 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 65 FOLLOWER]: Leader election lost for term 65. Reason: could not achieve majority
I20260620 23:03:29.994474 31942 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 65 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:29.994582 31942 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 65 FOLLOWER]: Advancing to term 66
I20260620 23:03:29.995364 31942 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.995548 31942 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 66 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:29.995805 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 66 candidate_status { last_received { term: 63 index: 75 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:29.995877 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 65 FOLLOWER]: Advancing to term 66
I20260620 23:03:29.995812 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 66 candidate_status { last_received { term: 63 index: 75 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:29.996024 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 65 FOLLOWER]: Advancing to term 66
I20260620 23:03:29.996623 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 66.
I20260620 23:03:29.996754 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 66 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 66.
I20260620 23:03:29.996835 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 66 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:29.996927 31942 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 FOLLOWER]: Leader election won for term 66
I20260620 23:03:29.996981 31942 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:29.997031 31942 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 75, Committed index: 75, Last appended: 63.75, Last appended by leader: 75, Current term: 66, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:29.997509 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 63 to 66, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 66 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:30.074153 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 66 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 61 index: 74. Preceding OpId from leader: term: 66 index: 76. (index mismatch)
I20260620 23:03:30.074486 31942 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 74, Time since last communication: 0.000s
I20260620 23:03:30.075665 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 66 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 63 index: 75. Preceding OpId from leader: term: 66 index: 76. (index mismatch)
I20260620 23:03:30.075897 31942 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 76, Last known committed idx: 75, Time since last communication: 0.000s
I20260620 23:03:30.176232 31944 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 66 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:30.176362 31944 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 66 FOLLOWER]: Advancing to term 67
I20260620 23:03:30.177079 31944 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.177297 31944 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 67 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:30.177548 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:30.177589 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:30.177824 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 67 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:30.177986 31944 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Leader election lost for term 67. Reason: could not achieve majority
I20260620 23:03:30.186404 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 66. Current term is 67. Ops: []
I20260620 23:03:30.186723 31945 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 66.76, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260620 23:03:30.186853 31945 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 LEADER]: Stepping down as leader of term 66
I20260620 23:03:30.186872 31945 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:30.186913 31945 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 66, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.186998 31945 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 66 FOLLOWER]: Advancing to term 67
I20260620 23:03:30.253096 31943 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 66 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:30.253198 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 66 FOLLOWER]: Advancing to term 67
I20260620 23:03:30.254837 31943 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.255103 31943 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 67 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:30.255234 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:30.255323 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 67: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:30.255342 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 67 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:30.255995 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 67 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 67.
I20260620 23:03:30.256176 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 67 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:30.256269 31943 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 FOLLOWER]: Leader election won for term 67
I20260620 23:03:30.256336 31943 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:30.256387 31943 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 67, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.256867 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 66 to 67, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 67 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:30.323802 31944 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:30.323997 31944 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 67 FOLLOWER]: Advancing to term 68
I20260620 23:03:30.324716 31944 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.324956 31944 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 68 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:30.325213 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 68 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:30.325213 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 68 candidate_status { last_received { term: 66 index: 76 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:30.325412 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 67 FOLLOWER]: Advancing to term 68
I20260620 23:03:30.325965 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 68 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 68.
I20260620 23:03:30.326150 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 68 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:30.326249 31944 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 FOLLOWER]: Leader election won for term 68
I20260620 23:03:30.326373 31944 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:30.326416 31944 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 66.76, Last appended by leader: 76, Current term: 68, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.326908 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 67 to 68, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 68 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:30.344414 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 68 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 67. Current term is 68. Ops: []
I20260620 23:03:30.344748 31943 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260620 23:03:30.344873 31943 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 LEADER]: Stepping down as leader of term 67
I20260620 23:03:30.344892 31943 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:30.344959 31943 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 76, Committed index: 76, Last appended: 67.77, Last appended by leader: 77, Current term: 67, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.345052 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 67 FOLLOWER]: Advancing to term 68
I20260620 23:03:30.425734 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 68 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 66 index: 76. Preceding OpId from leader: term: 68 index: 77. (index mismatch)
I20260620 23:03:30.426047 31944 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260620 23:03:30.427208 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 68 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 67 index: 77. Preceding OpId from leader: term: 68 index: 77. (term mismatch)
I20260620 23:03:30.427263 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 76
I20260620 23:03:30.427282 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 67.77
I20260620 23:03:30.427304 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 68 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:30.427493 31947 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 77, Last known committed idx: 76, Time since last communication: 0.000s
I20260620 23:03:30.645643 31943 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 68 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:30.645797 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 68 FOLLOWER]: Advancing to term 69
I20260620 23:03:30.646495 31943 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.646733 31943 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 69 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:30.647012 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:30.647063 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:30.647370 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 69 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:30.647480 31943 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Leader election lost for term 69. Reason: could not achieve majority
I20260620 23:03:30.655793 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 68. Current term is 69. Ops: []
I20260620 23:03:30.656154 31944 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 68.77, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260620 23:03:30.656324 31947 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 LEADER]: Stepping down as leader of term 68
I20260620 23:03:30.656375 31947 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:30.656448 31947 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 68, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.656541 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 68 FOLLOWER]: Advancing to term 69
I20260620 23:03:30.712314 31945 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 68 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:30.712427 31945 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 68 FOLLOWER]: Advancing to term 69
I20260620 23:03:30.713229 31945 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.713436 31945 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 69 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:30.713727 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:30.713769 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 69 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:30.713915 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 69: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:30.714460 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 69 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 69.
I20260620 23:03:30.714726 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 69 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:30.714879 31945 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 FOLLOWER]: Leader election won for term 69
I20260620 23:03:30.715024 31945 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:30.715102 31945 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 69, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.715790 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 68 to 69, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 69 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:30.758123 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:30.771332 31943 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:30.771443 31943 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 69 FOLLOWER]: Advancing to term 70
I20260620 23:03:30.772279 31943 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.772490 31943 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 70 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:30.772730 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 70 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:30.772735 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 70 candidate_status { last_received { term: 68 index: 77 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:30.772852 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 69 FOLLOWER]: Advancing to term 70
I20260620 23:03:30.773483 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 70 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 70.
I20260620 23:03:30.773705 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 70 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:30.773873 31943 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 FOLLOWER]: Leader election won for term 70
I20260620 23:03:30.773993 31943 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:30.774075 31943 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 68.77, Last appended by leader: 77, Current term: 70, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.774694 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 69 to 70, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 70 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:30.803668 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 70 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 69. Current term is 70. Ops: []
I20260620 23:03:30.804078 31945 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260620 23:03:30.804205 31945 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 LEADER]: Stepping down as leader of term 69
I20260620 23:03:30.804224 31945 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:30.804288 31945 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 77, Committed index: 77, Last appended: 69.78, Last appended by leader: 78, Current term: 69, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:30.804359 31945 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 69 FOLLOWER]: Advancing to term 70
I20260620 23:03:30.854043 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 70 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 68 index: 77. Preceding OpId from leader: term: 70 index: 78. (index mismatch)
I20260620 23:03:30.854367 31943 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260620 23:03:30.855808 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 70 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 69 index: 78. Preceding OpId from leader: term: 70 index: 78. (term mismatch)
I20260620 23:03:30.855862 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 77
I20260620 23:03:30.855883 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 69.78
I20260620 23:03:30.855907 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 70 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:30.856081 31949 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 78, Last known committed idx: 77, Time since last communication: 0.000s
I20260620 23:03:31.066509 31945 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 70 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:31.066625 31945 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 70 FOLLOWER]: Advancing to term 71
I20260620 23:03:31.067536 31945 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.067765 31945 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 71 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:31.068140 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.068161 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:31.068460 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 71 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:31.068564 31945 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Leader election lost for term 71. Reason: could not achieve majority
I20260620 23:03:31.076400 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 70. Current term is 71. Ops: []
I20260620 23:03:31.076735 31943 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 70.78, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260620 23:03:31.077018 31949 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 LEADER]: Stepping down as leader of term 70
I20260620 23:03:31.077075 31949 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:31.077163 31949 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 70.78, Last appended by leader: 78, Current term: 70, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.077263 31949 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 70 FOLLOWER]: Advancing to term 71
I20260620 23:03:31.134519 31947 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 70 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:31.134634 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 70 FOLLOWER]: Advancing to term 71
I20260620 23:03:31.135378 31947 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.135581 31947 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 71 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:31.135866 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.135866 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 71 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:31.136023 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 71: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:31.136716 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 71 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 71.
I20260620 23:03:31.136919 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 71 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:31.137058 31947 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 FOLLOWER]: Leader election won for term 71
I20260620 23:03:31.137145 31947 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:31.137234 31947 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 70.78, Last appended by leader: 78, Current term: 71, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.137742 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 70 to 71, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 71 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:31.181116 31945 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:31.181233 31945 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 71 FOLLOWER]: Advancing to term 72
I20260620 23:03:31.181922 31945 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.182157 31945 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 72 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:31.182372 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 72 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:31.182433 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 72 candidate_status { last_received { term: 70 index: 78 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.182552 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 71 FOLLOWER]: Advancing to term 72
I20260620 23:03:31.183175 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 72 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 72.
I20260620 23:03:31.183347 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 72 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:31.183455 31945 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 FOLLOWER]: Leader election won for term 72
I20260620 23:03:31.183516 31945 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:31.183573 31945 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 70.78, Last appended by leader: 78, Current term: 72, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.184034 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 71 to 72, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 72 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:31.234601 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 72 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 71. Current term is 72. Ops: []
I20260620 23:03:31.234998 31947 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260620 23:03:31.235172 31947 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 LEADER]: Stepping down as leader of term 71
I20260620 23:03:31.235232 31947 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:31.235312 31947 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 78, Committed index: 78, Last appended: 71.79, Last appended by leader: 79, Current term: 71, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.235410 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 71 FOLLOWER]: Advancing to term 72
I20260620 23:03:31.262701 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 72 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 70 index: 78. Preceding OpId from leader: term: 72 index: 79. (index mismatch)
I20260620 23:03:31.262980 31945 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260620 23:03:31.264086 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 72 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 71 index: 79. Preceding OpId from leader: term: 72 index: 79. (term mismatch)
I20260620 23:03:31.264138 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 78
I20260620 23:03:31.264158 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 71.79
I20260620 23:03:31.264178 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 72 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:31.264336 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 79, Last known committed idx: 78, Time since last communication: 0.000s
I20260620 23:03:31.364117 31949 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 72 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:31.364221 31949 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 72 FOLLOWER]: Advancing to term 73
I20260620 23:03:31.364943 31949 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.365134 31949 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 73 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:31.365396 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 73 candidate_status { last_received { term: 72 index: 79 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:31.365396 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 73 candidate_status { last_received { term: 72 index: 79 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:31.365517 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 72 FOLLOWER]: Advancing to term 73
I20260620 23:03:31.366094 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 73 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 73.
I20260620 23:03:31.366263 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 73 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:31.366353 31949 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 FOLLOWER]: Leader election won for term 73
I20260620 23:03:31.366447 31949 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:31.366535 31949 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 72.79, Last appended by leader: 79, Current term: 73, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.367007 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 72 to 73, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 73 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:31.367889 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 73 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 72. Current term is 73. Ops: []
I20260620 23:03:31.368101 31950 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 72.79, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260620 23:03:31.368217 31950 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 LEADER]: Stepping down as leader of term 72
I20260620 23:03:31.368251 31950 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:31.368306 31950 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 79, Committed index: 79, Last appended: 72.79, Last appended by leader: 79, Current term: 72, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.368364 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 72 FOLLOWER]: Advancing to term 73
I20260620 23:03:31.453827 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 73 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 72 index: 79. Preceding OpId from leader: term: 73 index: 80. (index mismatch)
I20260620 23:03:31.454180 31949 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260620 23:03:31.455407 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 73 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 72 index: 79. Preceding OpId from leader: term: 73 index: 80. (index mismatch)
I20260620 23:03:31.455650 31951 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 80, Last known committed idx: 79, Time since last communication: 0.000s
I20260620 23:03:31.654580 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 73 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:31.654693 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 73 FOLLOWER]: Advancing to term 74
I20260620 23:03:31.655433 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.655624 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 74 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:31.655858 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.655858 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:31.656196 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 74 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:31.656280 31950 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Leader election lost for term 74. Reason: could not achieve majority
I20260620 23:03:31.670061 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 73. Current term is 74. Ops: []
I20260620 23:03:31.670377 31949 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 73.80, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260620 23:03:31.670521 31949 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 LEADER]: Stepping down as leader of term 73
I20260620 23:03:31.670553 31949 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:31.670637 31949 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 73, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.670733 31949 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 73 FOLLOWER]: Advancing to term 74
I20260620 23:03:31.740701 31947 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 73 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:31.740818 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 73 FOLLOWER]: Advancing to term 74
I20260620 23:03:31.741526 31947 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.741721 31947 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 74 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:31.742007 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.742007 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 74 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:31.742152 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 74: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:31.742712 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 74 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 74.
I20260620 23:03:31.743001 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 74 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:31.743095 31947 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 FOLLOWER]: Leader election won for term 74
I20260620 23:03:31.743206 31947 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:31.743250 31947 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 74, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.743777 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 73 to 74, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 74 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:31.758428 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:31.779965 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:31.780097 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 74 FOLLOWER]: Advancing to term 75
I20260620 23:03:31.780805 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.781015 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 75 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:31.781268 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:31.781282 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 75 candidate_status { last_received { term: 73 index: 80 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:31.781447 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 74 FOLLOWER]: Advancing to term 75
I20260620 23:03:31.782101 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 75 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 75.
I20260620 23:03:31.782352 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 75 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:31.782516 31950 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 FOLLOWER]: Leader election won for term 75
I20260620 23:03:31.782603 31950 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:31.782668 31950 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 73.80, Last appended by leader: 80, Current term: 75, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.783253 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 74 to 75, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 75 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:31.839411 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 75 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 74. Current term is 75. Ops: []
I20260620 23:03:31.839720 31947 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260620 23:03:31.839829 31947 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 LEADER]: Stepping down as leader of term 74
I20260620 23:03:31.839846 31947 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:31.839954 31947 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 80, Committed index: 80, Last appended: 74.81, Last appended by leader: 81, Current term: 74, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:31.840034 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 74 FOLLOWER]: Advancing to term 75
I20260620 23:03:31.863215 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 75 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 74 index: 81. Preceding OpId from leader: term: 75 index: 81. (term mismatch)
I20260620 23:03:31.863294 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 80
I20260620 23:03:31.863327 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 74.81
I20260620 23:03:31.863375 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 75 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:31.863639 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260620 23:03:31.864805 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 75 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 73 index: 80. Preceding OpId from leader: term: 75 index: 81. (index mismatch)
I20260620 23:03:31.864995 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 81, Last known committed idx: 80, Time since last communication: 0.000s
I20260620 23:03:32.058389 31949 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 75 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:32.058477 31949 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 75 FOLLOWER]: Advancing to term 76
I20260620 23:03:32.059209 31949 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.059403 31949 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 76 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:32.059669 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:32.059713 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:32.060007 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 76 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:32.060149 31949 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Leader election lost for term 76. Reason: could not achieve majority
I20260620 23:03:32.069316 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 75. Current term is 76. Ops: []
I20260620 23:03:32.069681 31948 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 75.81, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260620 23:03:32.069913 31950 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 LEADER]: Stepping down as leader of term 75
I20260620 23:03:32.069957 31950 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:32.070030 31950 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 75, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.070125 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 75 FOLLOWER]: Advancing to term 76
I20260620 23:03:32.156311 31947 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 75 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:32.156420 31947 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 75 FOLLOWER]: Advancing to term 76
I20260620 23:03:32.157079 31947 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.157262 31947 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 76 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:32.157557 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:32.157660 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 76: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:32.157572 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 76 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:32.158313 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 76 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 76.
I20260620 23:03:32.158512 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 76 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:32.158633 31947 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 FOLLOWER]: Leader election won for term 76
I20260620 23:03:32.158695 31947 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:32.158749 31947 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 76, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.159284 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 75 to 76, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 76 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:32.183064 31949 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:32.183166 31949 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 76 FOLLOWER]: Advancing to term 77
I20260620 23:03:32.183845 31949 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.184037 31949 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 77 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:32.184284 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:32.184294 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 77 candidate_status { last_received { term: 75 index: 81 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:32.184432 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 76 FOLLOWER]: Advancing to term 77
I20260620 23:03:32.185083 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 77 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 77.
I20260620 23:03:32.185276 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 77 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:32.185402 31949 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 FOLLOWER]: Leader election won for term 77
I20260620 23:03:32.185534 31949 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:32.185590 31949 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 75.81, Last appended by leader: 81, Current term: 77, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.186125 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 76 to 77, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 77 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:32.248144 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 76. Current term is 77. Ops: []
I20260620 23:03:32.248502 31947 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260620 23:03:32.248690 31947 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 77.82 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 81
I20260620 23:03:32.248747 31952 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 LEADER]: Stepping down as leader of term 76
I20260620 23:03:32.248811 31952 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:32.248926 31952 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 81, Committed index: 81, Last appended: 76.82, Last appended by leader: 82, Current term: 76, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.249042 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 76 FOLLOWER]: Advancing to term 77
I20260620 23:03:32.267323 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 77 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 76 index: 82. Preceding OpId from leader: term: 77 index: 82. (term mismatch)
I20260620 23:03:32.267424 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 81
I20260620 23:03:32.267446 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 76.82
I20260620 23:03:32.267472 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 77 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:32.267802 31949 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260620 23:03:32.268944 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 77 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 75 index: 81. Preceding OpId from leader: term: 77 index: 82. (index mismatch)
I20260620 23:03:32.269152 31953 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 82, Last known committed idx: 81, Time since last communication: 0.000s
I20260620 23:03:32.467849 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 77 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:32.468091 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 77 FOLLOWER]: Advancing to term 78
I20260620 23:03:32.468822 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.469004 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 78 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:32.469202 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:32.469226 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:32.469585 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 78 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:32.469691 31950 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Leader election lost for term 78. Reason: could not achieve majority
I20260620 23:03:32.478904 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 77. Current term is 78. Ops: []
I20260620 23:03:32.479260 31953 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 77.82, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260620 23:03:32.479395 31953 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 LEADER]: Stepping down as leader of term 77
I20260620 23:03:32.479418 31953 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:32.479516 31953 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 77, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.479627 31953 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 77 FOLLOWER]: Advancing to term 78
I20260620 23:03:32.558341 31952 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 77 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:32.558439 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 77 FOLLOWER]: Advancing to term 78
I20260620 23:03:32.559134 31952 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.559418 31952 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 78 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:32.559553 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:32.559615 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 78 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:32.559757 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 78: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:32.560395 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 78 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 78.
I20260620 23:03:32.560562 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 78 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:32.560652 31952 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 FOLLOWER]: Leader election won for term 78
I20260620 23:03:32.560707 31952 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:32.560781 31952 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 78, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.561225 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 77 to 78, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 78 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:32.618321 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:32.618484 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 78 FOLLOWER]: Advancing to term 79
I20260620 23:03:32.619321 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.619567 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 79 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:32.619817 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 79 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:32.619850 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 79 candidate_status { last_received { term: 77 index: 82 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:32.619964 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 78 FOLLOWER]: Advancing to term 79
I20260620 23:03:32.620558 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 79 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 79.
I20260620 23:03:32.620803 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 79 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:32.620949 31950 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 FOLLOWER]: Leader election won for term 79
I20260620 23:03:32.621037 31950 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:32.621088 31950 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 77.82, Last appended by leader: 82, Current term: 79, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.621672 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 78 to 79, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 79 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:32.638895 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 79 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 78. Current term is 79. Ops: []
I20260620 23:03:32.639231 31952 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260620 23:03:32.639392 31952 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 LEADER]: Stepping down as leader of term 78
I20260620 23:03:32.639433 31952 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:32.639499 31952 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 82, Committed index: 82, Last appended: 78.83, Last appended by leader: 83, Current term: 78, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:32.639588 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 78 FOLLOWER]: Advancing to term 79
I20260620 23:03:32.725709 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 79 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 77 index: 82. Preceding OpId from leader: term: 79 index: 83. (index mismatch)
I20260620 23:03:32.726063 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260620 23:03:32.727416 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 79 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 78 index: 83. Preceding OpId from leader: term: 79 index: 83. (term mismatch)
I20260620 23:03:32.727471 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 82
I20260620 23:03:32.727530 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 78.83
I20260620 23:03:32.727562 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 79 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:32.727730 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 83, Last known committed idx: 82, Time since last communication: 0.000s
I20260620 23:03:32.758729 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:33.077953 31952 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 79 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:33.078060 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 79 FOLLOWER]: Advancing to term 80
I20260620 23:03:33.078819 31952 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.079056 31952 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 80 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:33.079335 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 80 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:33.079360 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 80 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:33.079661 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 80 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:33.079767 31952 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Leader election lost for term 80. Reason: could not achieve majority
I20260620 23:03:33.096506 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 79. Current term is 80. Ops: []
I20260620 23:03:33.096833 31950 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 79.83, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260620 23:03:33.096988 31948 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 LEADER]: Stepping down as leader of term 79
I20260620 23:03:33.097033 31948 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:33.097111 31948 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 79.83, Last appended by leader: 83, Current term: 79, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.097182 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 79 FOLLOWER]: Advancing to term 80
I20260620 23:03:33.188192 31953 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 79 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:33.188292 31953 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 79 FOLLOWER]: Advancing to term 80
I20260620 23:03:33.189239 31953 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.189559 31953 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 80 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:33.189749 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 80 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:33.189757 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 80 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:33.189934 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 80: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:33.190506 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 80 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 80.
I20260620 23:03:33.190701 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 80 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:33.190842 31953 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 FOLLOWER]: Leader election won for term 80
I20260620 23:03:33.190977 31953 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:33.191044 31953 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 79.83, Last appended by leader: 83, Current term: 80, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.191557 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 79 to 80, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 80 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:33.211412 31952 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:33.211553 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 80 FOLLOWER]: Advancing to term 81
I20260620 23:03:33.212332 31952 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.212564 31952 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 81 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:33.212795 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 81 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:33.212795 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 81 candidate_status { last_received { term: 79 index: 83 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:33.212918 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 80 FOLLOWER]: Advancing to term 81
I20260620 23:03:33.213480 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 81 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 81.
I20260620 23:03:33.213691 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 81 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:33.213793 31952 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 FOLLOWER]: Leader election won for term 81
I20260620 23:03:33.213927 31952 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:33.213986 31952 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 79.83, Last appended by leader: 83, Current term: 81, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.214510 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 80 to 81, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 81 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:33.266985 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 81 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 80. Current term is 81. Ops: []
I20260620 23:03:33.267436 31953 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260620 23:03:33.267623 31953 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 LEADER]: Stepping down as leader of term 80
I20260620 23:03:33.267686 31953 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:33.267763 31953 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 83, Committed index: 83, Last appended: 80.84, Last appended by leader: 84, Current term: 80, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.267870 31953 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 80 FOLLOWER]: Advancing to term 81
I20260620 23:03:33.316429 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 81 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 79 index: 83. Preceding OpId from leader: term: 81 index: 84. (index mismatch)
I20260620 23:03:33.316747 31952 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260620 23:03:33.318130 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 81 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 80 index: 84. Preceding OpId from leader: term: 81 index: 84. (term mismatch)
I20260620 23:03:33.318192 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 83
I20260620 23:03:33.318212 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 80.84
I20260620 23:03:33.318240 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 81 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:33.318413 31959 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 84, Last known committed idx: 83, Time since last communication: 0.000s
I20260620 23:03:33.418110 31948 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 81 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:33.418215 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 81 FOLLOWER]: Advancing to term 82
I20260620 23:03:33.419173 31948 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.419428 31948 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 82 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:33.419706 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 82 candidate_status { last_received { term: 81 index: 84 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:33.419706 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 82 candidate_status { last_received { term: 81 index: 84 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:33.419831 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 81 FOLLOWER]: Advancing to term 82
I20260620 23:03:33.420500 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 82 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 82.
I20260620 23:03:33.420729 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 82 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:33.420838 31948 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 FOLLOWER]: Leader election won for term 82
I20260620 23:03:33.420885 31948 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:33.420936 31948 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 81.84, Last appended by leader: 84, Current term: 82, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.421452 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 81 to 82, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 82 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:33.423601 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 81. Current term is 82. Ops: []
I20260620 23:03:33.423870 31952 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 81.84, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260620 23:03:33.423993 31952 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 82.85 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 84
I20260620 23:03:33.424019 31952 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 LEADER]: Stepping down as leader of term 81
I20260620 23:03:33.424036 31952 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:33.424114 31952 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 84, Committed index: 84, Last appended: 81.84, Last appended by leader: 84, Current term: 81, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.424199 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 81 FOLLOWER]: Advancing to term 82
I20260620 23:03:33.513485 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 82 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 81 index: 84. Preceding OpId from leader: term: 82 index: 85. (index mismatch)
I20260620 23:03:33.513839 31948 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260620 23:03:33.515004 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 82 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 81 index: 84. Preceding OpId from leader: term: 82 index: 85. (index mismatch)
I20260620 23:03:33.515276 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 85, Last known committed idx: 84, Time since last communication: 0.000s
I20260620 23:03:33.616528 31953 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 82 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:33.616643 31953 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 82 FOLLOWER]: Advancing to term 83
I20260620 23:03:33.617341 31953 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.617575 31953 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 83 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:33.617796 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:33.617880 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 82 FOLLOWER]: Advancing to term 83
I20260620 23:03:33.617916 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 83 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:33.618621 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 83 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 83.
I20260620 23:03:33.618841 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 83 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:33.618942 31953 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 FOLLOWER]: Leader election won for term 83
I20260620 23:03:33.619020 31953 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:33.619078 31953 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 83, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.619536 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 82 to 83, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 83 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:33.637223 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 83 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 82. Current term is 83. Ops: []
I20260620 23:03:33.637511 31950 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 82.85, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260620 23:03:33.637663 31950 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 LEADER]: Stepping down as leader of term 82
I20260620 23:03:33.637722 31950 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:33.637789 31950 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 82, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.637926 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 82 FOLLOWER]: Advancing to term 83
I20260620 23:03:33.732357 31952 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 83 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:33.732462 31952 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 83 FOLLOWER]: Advancing to term 84
I20260620 23:03:33.733294 31952 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.733492 31952 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 84 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:33.733747 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 84 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:33.733747 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 84 candidate_status { last_received { term: 82 index: 85 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:33.733858 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 83 FOLLOWER]: Advancing to term 84
I20260620 23:03:33.734400 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 84 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 84.
I20260620 23:03:33.734589 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 84 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:33.734690 31952 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 FOLLOWER]: Leader election won for term 84
I20260620 23:03:33.734743 31952 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:33.734793 31952 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 82.85, Last appended by leader: 85, Current term: 84, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.735157 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 83. Current term is 84. Ops: []
I20260620 23:03:33.735354 31953 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260620 23:03:33.735359 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 83 to 84, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 84 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:33.735455 31953 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 84.86 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 85
I20260620 23:03:33.735497 31954 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 LEADER]: Stepping down as leader of term 83
I20260620 23:03:33.735549 31954 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:33.735608 31954 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 85, Committed index: 85, Last appended: 83.86, Last appended by leader: 86, Current term: 83, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.735698 31954 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 83 FOLLOWER]: Advancing to term 84
I20260620 23:03:33.759084 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:33.811685 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 84 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 83 index: 86. Preceding OpId from leader: term: 84 index: 86. (term mismatch)
I20260620 23:03:33.811761 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 85
I20260620 23:03:33.811775 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 83.86
I20260620 23:03:33.811792 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 84 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:33.812111 31952 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260620 23:03:33.813146 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 84 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 82 index: 85. Preceding OpId from leader: term: 84 index: 86. (index mismatch)
I20260620 23:03:33.813400 31958 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 86, Last known committed idx: 85, Time since last communication: 0.000s
I20260620 23:03:33.914167 31948 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 84 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:33.914331 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 84 FOLLOWER]: Advancing to term 85
I20260620 23:03:33.915208 31948 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.915459 31948 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 85 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:33.915720 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 85 candidate_status { last_received { term: 84 index: 86 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:33.915735 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 85 candidate_status { last_received { term: 84 index: 86 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:33.915946 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 84 FOLLOWER]: Advancing to term 85
I20260620 23:03:33.916579 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 85 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 85.
I20260620 23:03:33.916738 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 85 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:33.916859 31948 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 FOLLOWER]: Leader election won for term 85
I20260620 23:03:33.916917 31948 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:33.916975 31948 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 84.86, Last appended by leader: 86, Current term: 85, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.917511 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 84 to 85, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 85 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:33.924242 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 85 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 84. Current term is 85. Ops: []
I20260620 23:03:33.924489 31958 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 84.86, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260620 23:03:33.924616 31959 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 LEADER]: Stepping down as leader of term 84
I20260620 23:03:33.924659 31959 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:33.924732 31959 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 86, Committed index: 86, Last appended: 84.86, Last appended by leader: 86, Current term: 84, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:33.924815 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 84 FOLLOWER]: Advancing to term 85
I20260620 23:03:33.998332 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 85 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 84 index: 86. Preceding OpId from leader: term: 85 index: 87. (index mismatch)
I20260620 23:03:33.998646 31948 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260620 23:03:33.999846 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 85 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 84 index: 86. Preceding OpId from leader: term: 85 index: 87. (index mismatch)
I20260620 23:03:34.000111 31960 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 87, Last known committed idx: 86, Time since last communication: 0.000s
I20260620 23:03:34.200117 31959 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 85 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:34.200227 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 85 FOLLOWER]: Advancing to term 86
I20260620 23:03:34.201040 31959 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.201190 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 85. Current term is 86. Ops: []
I20260620 23:03:34.201416 31948 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 85.87, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260620 23:03:34.201442 31959 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 86 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.201432 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:34.201692 31950 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 LEADER]: Stepping down as leader of term 85
I20260620 23:03:34.201735 31950 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:34.201709 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.201783 31950 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 85, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.201864 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 85 FOLLOWER]: Advancing to term 86
I20260620 23:03:34.201947 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 86 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:34.202078 31959 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Leader election lost for term 86. Reason: could not achieve majority
I20260620 23:03:34.258517 31954 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 85 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:34.258648 31954 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 85 FOLLOWER]: Advancing to term 86
I20260620 23:03:34.259371 31954 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.259579 31954 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 86 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.259800 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:34.259894 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 86: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:34.259861 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 86 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.260629 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 86 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 86.
I20260620 23:03:34.260838 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 86 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:34.260987 31954 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 FOLLOWER]: Leader election won for term 86
I20260620 23:03:34.261124 31954 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:34.261221 31954 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 86, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.261703 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 85 to 86, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 86 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:34.344950 31959 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:34.345059 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 86 FOLLOWER]: Advancing to term 87
I20260620 23:03:34.345762 31959 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.345973 31959 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 87 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.346194 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 87 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:34.346233 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 87 candidate_status { last_received { term: 85 index: 87 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.346326 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 86 FOLLOWER]: Advancing to term 87
I20260620 23:03:34.346900 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 87 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 87.
I20260620 23:03:34.347118 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 87 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:34.347241 31959 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 FOLLOWER]: Leader election won for term 87
I20260620 23:03:34.347312 31959 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:34.347383 31959 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 85.87, Last appended by leader: 87, Current term: 87, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.347905 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 86 to 87, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 87 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:34.380740 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 87 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 86. Current term is 87. Ops: []
I20260620 23:03:34.381147 31954 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260620 23:03:34.381331 31954 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 LEADER]: Stepping down as leader of term 86
I20260620 23:03:34.381385 31954 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:34.381462 31954 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 87, Committed index: 87, Last appended: 86.88, Last appended by leader: 88, Current term: 86, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.381551 31954 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 86 FOLLOWER]: Advancing to term 87
I20260620 23:03:34.425673 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 87 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 85 index: 87. Preceding OpId from leader: term: 87 index: 88. (index mismatch)
I20260620 23:03:34.426040 31959 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260620 23:03:34.427310 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 87 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 86 index: 88. Preceding OpId from leader: term: 87 index: 88. (term mismatch)
I20260620 23:03:34.427383 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 87
I20260620 23:03:34.427410 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 86.88
I20260620 23:03:34.427431 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 87 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:34.427615 31962 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 88, Last known committed idx: 87, Time since last communication: 0.000s
I20260620 23:03:34.610546 31954 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 87 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:34.610657 31954 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 87 FOLLOWER]: Advancing to term 88
I20260620 23:03:34.611356 31954 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.611568 31954 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 88 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.611804 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.611810 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:34.612188 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 88 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:34.612335 31954 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Leader election lost for term 88. Reason: could not achieve majority
I20260620 23:03:34.633098 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 87. Current term is 88. Ops: []
I20260620 23:03:34.633416 31959 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 87.88, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260620 23:03:34.633605 31962 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 LEADER]: Stepping down as leader of term 87
I20260620 23:03:34.633726 31962 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:34.633832 31962 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 87, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.634004 31962 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 87 FOLLOWER]: Advancing to term 88
I20260620 23:03:34.682886 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 87 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:34.682993 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 87 FOLLOWER]: Advancing to term 88
I20260620 23:03:34.683779 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.683967 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 88 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:34.684242 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:34.684262 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 88 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:34.684358 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 88: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:34.684998 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 88 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 88.
I20260620 23:03:34.685180 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 88 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:34.685307 31950 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 FOLLOWER]: Leader election won for term 88
I20260620 23:03:34.685369 31950 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:34.685420 31950 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 88, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.685911 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 87 to 88, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 88 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:34.730883 31954 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:34.730989 31954 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 88 FOLLOWER]: Advancing to term 89
I20260620 23:03:34.731694 31954 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.731914 31954 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 89 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.732165 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 89 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:34.732191 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 89 candidate_status { last_received { term: 87 index: 88 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.732255 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 88 FOLLOWER]: Advancing to term 89
I20260620 23:03:34.732847 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 89 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 89.
I20260620 23:03:34.733098 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 89 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:34.733228 31954 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 FOLLOWER]: Leader election won for term 89
I20260620 23:03:34.733295 31954 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:34.733382 31954 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 87.88, Last appended by leader: 88, Current term: 89, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.733875 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 88 to 89, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 89 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:34.759406 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:34.770648 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 LEADER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 88. Current term is 89. Ops: []
I20260620 23:03:34.770907 31950 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260620 23:03:34.771052 31950 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 89.89 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 88
I20260620 23:03:34.771092 31948 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 LEADER]: Stepping down as leader of term 88
I20260620 23:03:34.771136 31948 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:34.771209 31948 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 88, Committed index: 88, Last appended: 88.89, Last appended by leader: 89, Current term: 88, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.771320 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 88 FOLLOWER]: Advancing to term 89
I20260620 23:03:34.810451 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 89 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 88 index: 89. Preceding OpId from leader: term: 89 index: 89. (term mismatch)
I20260620 23:03:34.810536 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 88
I20260620 23:03:34.810550 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 88.89
I20260620 23:03:34.810566 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 89 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:34.810830 31954 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260620 23:03:34.812155 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 89 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 87 index: 88. Preceding OpId from leader: term: 89 index: 89. (index mismatch)
I20260620 23:03:34.812392 31954 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 89, Last known committed idx: 88, Time since last communication: 0.000s
I20260620 23:03:34.912758 31962 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 89 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:34.912869 31962 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 89 FOLLOWER]: Advancing to term 90
I20260620 23:03:34.913635 31962 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.913837 31962 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 90 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:34.914191 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:34.914191 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 90 candidate_status { last_received { term: 89 index: 89 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:34.914353 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 89 FOLLOWER]: Advancing to term 90
I20260620 23:03:34.915000 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 90 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 90.
I20260620 23:03:34.915203 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 90 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:34.915321 31962 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 FOLLOWER]: Leader election won for term 90
I20260620 23:03:34.915406 31962 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:34.915465 31962 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 89.89, Last appended by leader: 89, Current term: 90, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.915920 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 89 to 90, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 90 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:34.919952 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 89. Current term is 90. Ops: []
I20260620 23:03:34.920231 31961 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 89.89, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260620 23:03:34.920359 31961 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 90.90 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 89
I20260620 23:03:34.920409 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 LEADER]: Stepping down as leader of term 89
I20260620 23:03:34.920460 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:34.920542 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 89, Committed index: 89, Last appended: 89.89, Last appended by leader: 89, Current term: 89, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:34.920656 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 89 FOLLOWER]: Advancing to term 90
I20260620 23:03:35.005745 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 90 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 89 index: 89. Preceding OpId from leader: term: 90 index: 90. (index mismatch)
I20260620 23:03:35.006369 31962 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260620 23:03:35.007890 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 90 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 89 index: 89. Preceding OpId from leader: term: 90 index: 90. (index mismatch)
I20260620 23:03:35.008152 31959 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 90, Last known committed idx: 89, Time since last communication: 0.000s
I20260620 23:03:35.108772 31948 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 90 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:35.108922 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 90 FOLLOWER]: Advancing to term 91
I20260620 23:03:35.109761 31948 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.109941 31948 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 91 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:35.110172 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.110167 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:35.110508 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 91 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:35.110625 31948 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Leader election lost for term 91. Reason: could not achieve majority
I20260620 23:03:35.131448 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 90. Current term is 91. Ops: []
I20260620 23:03:35.131774 31962 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 90.90, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 23:03:35.131943 31959 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 LEADER]: Stepping down as leader of term 90
I20260620 23:03:35.132020 31959 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:35.132105 31959 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.90, Last appended by leader: 90, Current term: 90, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.132230 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 90 FOLLOWER]: Advancing to term 91
I20260620 23:03:35.190022 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 90 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:35.190140 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 90 FOLLOWER]: Advancing to term 91
I20260620 23:03:35.190908 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.191213 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 91 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:35.191314 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.191376 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 91 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:35.191465 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 91: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:35.192382 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 91 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 91.
I20260620 23:03:35.192555 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 91 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:35.192703 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 FOLLOWER]: Leader election won for term 91
I20260620 23:03:35.192787 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:35.192849 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.90, Last appended by leader: 90, Current term: 91, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.193535 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 90 to 91, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 91 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:35.222311 31948 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:35.222424 31948 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 91 FOLLOWER]: Advancing to term 92
I20260620 23:03:35.223449 31948 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.223657 31948 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 92 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:35.223847 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:35.223887 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 92 candidate_status { last_received { term: 90 index: 90 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.223997 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 91 FOLLOWER]: Advancing to term 92
I20260620 23:03:35.224853 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 92 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 92.
I20260620 23:03:35.225055 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 92 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:35.225162 31948 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 FOLLOWER]: Leader election won for term 92
I20260620 23:03:35.225212 31948 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:35.225265 31948 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 90.90, Last appended by leader: 90, Current term: 92, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.225697 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 91 to 92, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 92 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:35.298950 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 91. Current term is 92. Ops: []
I20260620 23:03:35.299335 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 23:03:35.299463 31963 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 92.91 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 90
I20260620 23:03:35.299489 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 LEADER]: Stepping down as leader of term 91
I20260620 23:03:35.299503 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:35.299597 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 90, Committed index: 90, Last appended: 91.91, Last appended by leader: 91, Current term: 91, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.299700 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 91 FOLLOWER]: Advancing to term 92
I20260620 23:03:35.318720 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 92 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 91 index: 91. Preceding OpId from leader: term: 92 index: 91. (term mismatch)
I20260620 23:03:35.318813 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 90
I20260620 23:03:35.318831 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 91.91
I20260620 23:03:35.318847 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 92 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:35.319113 31948 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 23:03:35.320582 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 92 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 90 index: 90. Preceding OpId from leader: term: 92 index: 91. (index mismatch)
I20260620 23:03:35.320817 31964 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 91, Last known committed idx: 90, Time since last communication: 0.000s
I20260620 23:03:35.612884 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 92 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:35.612991 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 92 FOLLOWER]: Advancing to term 93
I20260620 23:03:35.613756 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.613943 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 93 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:35.614203 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.614226 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:35.614509 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 93 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:35.614611 31963 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Leader election lost for term 93. Reason: could not achieve majority
I20260620 23:03:35.627525 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 92. Current term is 93. Ops: []
I20260620 23:03:35.627871 31964 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 92.91, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260620 23:03:35.628057 31950 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 LEADER]: Stepping down as leader of term 92
I20260620 23:03:35.628131 31950 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:35.628202 31950 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.91, Last appended by leader: 91, Current term: 92, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.628302 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 92 FOLLOWER]: Advancing to term 93
I20260620 23:03:35.676819 31959 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 92 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:35.676970 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 92 FOLLOWER]: Advancing to term 93
I20260620 23:03:35.677963 31959 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.678156 31959 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 93 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:35.678328 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:35.678370 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 93 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:35.678442 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 93: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:35.679077 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 93 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 93.
I20260620 23:03:35.679304 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 93 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:35.679442 31959 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 FOLLOWER]: Leader election won for term 93
I20260620 23:03:35.679567 31959 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:35.679622 31959 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.91, Last appended by leader: 91, Current term: 93, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.680174 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 92 to 93, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 93 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:35.718284 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:35.718394 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 93 FOLLOWER]: Advancing to term 94
I20260620 23:03:35.719173 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.719419 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 94 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:35.719691 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 94 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.719691 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 94 candidate_status { last_received { term: 92 index: 91 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:35.719841 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 93 FOLLOWER]: Advancing to term 94
I20260620 23:03:35.720487 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 94 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 94.
I20260620 23:03:35.720664 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 94 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:35.720772 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 FOLLOWER]: Leader election won for term 94
I20260620 23:03:35.720847 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:35.720902 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 92.91, Last appended by leader: 91, Current term: 94, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.721418 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 93 to 94, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 94 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:35.757864 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 93. Current term is 94. Ops: []
I20260620 23:03:35.758175 31959 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260620 23:03:35.758281 31959 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 94.92 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 91
I20260620 23:03:35.758306 31959 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 LEADER]: Stepping down as leader of term 93
I20260620 23:03:35.758343 31959 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:35.758419 31959 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 91, Committed index: 91, Last appended: 93.92, Last appended by leader: 92, Current term: 93, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.758495 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 93 FOLLOWER]: Advancing to term 94
I20260620 23:03:35.759670 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:35.799178 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 94 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 92 index: 91. Preceding OpId from leader: term: 94 index: 92. (index mismatch)
I20260620 23:03:35.799593 31963 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260620 23:03:35.800709 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 94 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 93 index: 92. Preceding OpId from leader: term: 94 index: 92. (term mismatch)
I20260620 23:03:35.800762 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 91
I20260620 23:03:35.800784 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 93.92
I20260620 23:03:35.800803 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 94 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:35.801090 31963 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 92, Last known committed idx: 91, Time since last communication: 0.000s
I20260620 23:03:35.901510 31950 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 94 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:35.901624 31950 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 94 FOLLOWER]: Advancing to term 95
I20260620 23:03:35.902657 31950 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.902918 31950 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 95 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:35.903147 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:35.903188 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 95 candidate_status { last_received { term: 94 index: 92 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:35.903247 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 94 FOLLOWER]: Advancing to term 95
I20260620 23:03:35.903968 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 95 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 95.
I20260620 23:03:35.904214 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 95 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:35.904320 31950 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 FOLLOWER]: Leader election won for term 95
I20260620 23:03:35.904376 31950 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:35.904450 31950 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 94.92, Last appended by leader: 92, Current term: 95, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.904956 31545 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 94 to 95, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 95 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:35.906781 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 94. Current term is 95. Ops: []
I20260620 23:03:35.907038 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 94.92, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260620 23:03:35.907124 31963 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 95.93 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 92
I20260620 23:03:35.907147 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 LEADER]: Stepping down as leader of term 94
I20260620 23:03:35.907161 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:35.907222 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 92, Committed index: 92, Last appended: 94.92, Last appended by leader: 92, Current term: 94, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:35.907306 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 94 FOLLOWER]: Advancing to term 95
I20260620 23:03:35.984004 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 95 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 94 index: 92. Preceding OpId from leader: term: 95 index: 93. (index mismatch)
I20260620 23:03:35.984359 31950 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260620 23:03:35.985643 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 95 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 94 index: 92. Preceding OpId from leader: term: 95 index: 93. (index mismatch)
I20260620 23:03:35.985847 31966 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 93, Last known committed idx: 92, Time since last communication: 0.000s
I20260620 23:03:36.272279 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 95 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:36.272405 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 95 FOLLOWER]: Advancing to term 96
I20260620 23:03:36.273138 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.273382 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 96 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:36.273639 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 96 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:36.273653 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 96 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:36.273999 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 96 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:36.274119 31963 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Leader election lost for term 96. Reason: could not achieve majority
I20260620 23:03:36.283831 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 95. Current term is 96. Ops: []
I20260620 23:03:36.284171 31966 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 95.93, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260620 23:03:36.284350 31964 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 LEADER]: Stepping down as leader of term 95
I20260620 23:03:36.284396 31964 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:36.284484 31964 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 95.93, Last appended by leader: 93, Current term: 95, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.284581 31964 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 95 FOLLOWER]: Advancing to term 96
I20260620 23:03:36.340351 31959 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 95 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:36.340478 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 95 FOLLOWER]: Advancing to term 96
I20260620 23:03:36.341176 31959 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.341408 31959 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 96 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:36.341617 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 96 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:36.341699 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 96: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:36.341630 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 96 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:36.342383 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 96 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 96.
I20260620 23:03:36.342638 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 96 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:36.342779 31959 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 FOLLOWER]: Leader election won for term 96
I20260620 23:03:36.342905 31959 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:36.342998 31959 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 95.93, Last appended by leader: 93, Current term: 96, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.343544 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 95 to 96, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 96 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:36.380762 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:36.380859 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 96 FOLLOWER]: Advancing to term 97
I20260620 23:03:36.381553 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.381752 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 97 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:36.381983 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 97 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:36.382072 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 97 candidate_status { last_received { term: 95 index: 93 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:36.382193 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 96 FOLLOWER]: Advancing to term 97
I20260620 23:03:36.382808 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 97 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 97.
I20260620 23:03:36.383044 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 97 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:36.383148 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 FOLLOWER]: Leader election won for term 97
I20260620 23:03:36.383198 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:36.383242 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 95.93, Last appended by leader: 93, Current term: 97, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.383780 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 96 to 97, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 97 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:36.420023 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 97 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 96. Current term is 97. Ops: []
I20260620 23:03:36.420327 31959 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260620 23:03:36.420467 31959 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 LEADER]: Stepping down as leader of term 96
I20260620 23:03:36.420517 31959 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:36.420578 31959 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 93, Committed index: 93, Last appended: 96.94, Last appended by leader: 94, Current term: 96, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.420655 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 96 FOLLOWER]: Advancing to term 97
I20260620 23:03:36.460294 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 97 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 96 index: 94. Preceding OpId from leader: term: 97 index: 94. (term mismatch)
I20260620 23:03:36.460394 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 93
I20260620 23:03:36.460414 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 96.94
I20260620 23:03:36.460440 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 97 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:36.460713 31963 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260620 23:03:36.461858 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 97 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 95 index: 93. Preceding OpId from leader: term: 97 index: 94. (index mismatch)
I20260620 23:03:36.462117 31963 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 94, Last known committed idx: 93, Time since last communication: 0.000s
I20260620 23:03:36.662055 31964 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 97 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:36.662179 31964 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 97 FOLLOWER]: Advancing to term 98
I20260620 23:03:36.662891 31964 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.663152 31964 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 98 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:36.663396 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 98 candidate_status { last_received { term: 97 index: 94 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:36.663429 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 98 candidate_status { last_received { term: 97 index: 94 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:36.663722 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 98 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:36.663883 31964 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Leader election lost for term 98. Reason: could not achieve majority
I20260620 23:03:36.670281 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 97. Current term is 98. Ops: []
I20260620 23:03:36.670658 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 97.94, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260620 23:03:36.670830 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 LEADER]: Stepping down as leader of term 97
I20260620 23:03:36.670883 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:36.670967 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 97.94, Last appended by leader: 94, Current term: 97, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.671072 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 97 FOLLOWER]: Advancing to term 98
I20260620 23:03:36.682919 31959 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 97 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:36.683018 31959 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 97 FOLLOWER]: Advancing to term 98
I20260620 23:03:36.683806 31959 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.683996 31959 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 98 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:36.684253 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 98 candidate_status { last_received { term: 97 index: 94 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:36.684271 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 98 candidate_status { last_received { term: 97 index: 94 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:36.684382 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 98: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:36.685094 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 98 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 98.
I20260620 23:03:36.685305 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 98 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:36.685405 31959 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 FOLLOWER]: Leader election won for term 98
I20260620 23:03:36.685458 31959 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:36.685513 31959 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 94, Committed index: 94, Last appended: 97.94, Last appended by leader: 94, Current term: 98, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.686002 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 97 to 98, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 98 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:36.759929 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:36.768761 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 97 index: 94. Preceding OpId from leader: term: 98 index: 95. (index mismatch)
I20260620 23:03:36.769066 31959 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260620 23:03:36.770408 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 98 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 97 index: 94. Preceding OpId from leader: term: 98 index: 95. (index mismatch)
I20260620 23:03:36.770606 31968 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 95, Last known committed idx: 94, Time since last communication: 0.000s
I20260620 23:03:36.870963 31964 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:36.871093 31964 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 98 FOLLOWER]: Advancing to term 99
I20260620 23:03:36.871806 31964 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.872090 31964 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 99 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:36.872306 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 99 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:36.872300 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 99 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:36.872602 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 99 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:36.872695 31964 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Leader election lost for term 99. Reason: could not achieve majority
I20260620 23:03:36.873502 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 98. Current term is 99. Ops: []
I20260620 23:03:36.873695 31968 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 98.95, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260620 23:03:36.873886 31969 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 LEADER]: Stepping down as leader of term 98
I20260620 23:03:36.873934 31969 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:36.874017 31969 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 98.95, Last appended by leader: 95, Current term: 98, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.874114 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 98 FOLLOWER]: Advancing to term 99
I20260620 23:03:36.953297 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 98 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:36.953446 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 98 FOLLOWER]: Advancing to term 99
I20260620 23:03:36.954123 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.954348 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 99 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:36.954595 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 99 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:36.954633 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 99 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:36.954792 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 99: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:36.955489 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 99 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 99.
I20260620 23:03:36.955698 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 99 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:36.955822 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 FOLLOWER]: Leader election won for term 99
I20260620 23:03:36.955886 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:36.955943 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 98.95, Last appended by leader: 95, Current term: 99, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:36.956478 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 98 to 99, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 99 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:37.009397 31964 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:37.009546 31964 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 99 FOLLOWER]: Advancing to term 100
I20260620 23:03:37.010543 31964 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.010749 31964 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 100 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:37.010982 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 100 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:37.011001 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 100 candidate_status { last_received { term: 98 index: 95 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:37.011152 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 99 FOLLOWER]: Advancing to term 100
I20260620 23:03:37.011783 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 100 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 100.
I20260620 23:03:37.012008 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 100 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:37.012161 31964 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 FOLLOWER]: Leader election won for term 100
I20260620 23:03:37.012318 31964 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:37.012420 31964 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 98.95, Last appended by leader: 95, Current term: 100, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.012992 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 99 to 100, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 100 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:37.076390 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 99. Current term is 100. Ops: []
I20260620 23:03:37.076510 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 100 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 99. Current term is 100. Ops: []
I20260620 23:03:37.076689 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260620 23:03:37.076924 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 LEADER]: Stepping down as leader of term 99
I20260620 23:03:37.077011 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:37.076953 31961 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260620 23:03:37.077164 31961 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 100.96 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 95
I20260620 23:03:37.077222 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 95, Committed index: 95, Last appended: 99.96, Last appended by leader: 96, Current term: 99, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.077325 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 99 FOLLOWER]: Advancing to term 100
I20260620 23:03:37.090644 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 100 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 99 index: 96. Preceding OpId from leader: term: 100 index: 96. (term mismatch)
I20260620 23:03:37.090723 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 95
I20260620 23:03:37.090736 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 99.96
I20260620 23:03:37.090752 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 100 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:37.091004 31964 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260620 23:03:37.092180 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 100 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 98 index: 95. Preceding OpId from leader: term: 100 index: 96. (index mismatch)
I20260620 23:03:37.092442 31972 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 96, Last known committed idx: 95, Time since last communication: 0.000s
I20260620 23:03:37.283113 31969 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 100 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:37.283211 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 100 FOLLOWER]: Advancing to term 101
I20260620 23:03:37.283988 31969 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.284221 31969 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 101 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:37.284379 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:37.284379 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:37.284695 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 101 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:37.284818 31969 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Leader election lost for term 101. Reason: could not achieve majority
I20260620 23:03:37.305774 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 100. Current term is 101. Ops: []
I20260620 23:03:37.306105 31970 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 100.96, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260620 23:03:37.306278 31972 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 LEADER]: Stepping down as leader of term 100
I20260620 23:03:37.306349 31972 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:37.306427 31972 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 100, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.306548 31972 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 100 FOLLOWER]: Advancing to term 101
I20260620 23:03:37.382429 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 100 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:37.382575 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 100 FOLLOWER]: Advancing to term 101
I20260620 23:03:37.383270 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.383490 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 101 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:37.383749 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:37.383749 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 101 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:37.383927 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 101: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:37.384572 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 101 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 101.
I20260620 23:03:37.384771 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 101 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:37.384879 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 FOLLOWER]: Leader election won for term 101
I20260620 23:03:37.384987 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:37.385064 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 101, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.385505 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 100 to 101, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 101 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:37.423748 31969 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:37.423883 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 101 FOLLOWER]: Advancing to term 102
I20260620 23:03:37.424721 31969 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.424974 31969 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 102 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:37.425194 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 102 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:37.425215 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 102 candidate_status { last_received { term: 100 index: 96 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:37.425374 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 101 FOLLOWER]: Advancing to term 102
I20260620 23:03:37.425972 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 102 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 102.
I20260620 23:03:37.426177 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 102 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:37.426313 31969 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 FOLLOWER]: Leader election won for term 102
I20260620 23:03:37.426452 31969 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:37.426532 31969 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 100.96, Last appended by leader: 96, Current term: 102, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.426990 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 101 to 102, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 102 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:37.483632 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 102 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 101. Current term is 102. Ops: []
I20260620 23:03:37.484007 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260620 23:03:37.484170 31963 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 LEADER]: Stepping down as leader of term 101
I20260620 23:03:37.484190 31963 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:37.484305 31963 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 96, Committed index: 96, Last appended: 101.97, Last appended by leader: 97, Current term: 101, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.484383 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 101 FOLLOWER]: Advancing to term 102
I20260620 23:03:37.508769 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 102 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 101 index: 97. Preceding OpId from leader: term: 102 index: 97. (term mismatch)
I20260620 23:03:37.508847 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 96
I20260620 23:03:37.508862 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 101.97
I20260620 23:03:37.508878 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 102 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:37.509186 31969 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260620 23:03:37.510306 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 102 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 100 index: 96. Preceding OpId from leader: term: 102 index: 97. (index mismatch)
I20260620 23:03:37.510476 31969 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 97, Last known committed idx: 96, Time since last communication: 0.000s
I20260620 23:03:37.611833 31972 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:37.611955 31972 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 102 FOLLOWER]: Advancing to term 103
I20260620 23:03:37.612686 31972 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.612883 31972 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 103 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:37.613147 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:37.613147 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:37.613471 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 103 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:37.613591 31972 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Leader election lost for term 103. Reason: could not achieve majority
I20260620 23:03:37.619983 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 102. Current term is 103. Ops: []
I20260620 23:03:37.620281 31969 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 102.97, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260620 23:03:37.620412 31969 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 LEADER]: Stepping down as leader of term 102
I20260620 23:03:37.620456 31969 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:37.620512 31969 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 102.97, Last appended by leader: 97, Current term: 102, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.620591 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 102 FOLLOWER]: Advancing to term 103
I20260620 23:03:37.710161 31963 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 102 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:37.710260 31963 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 102 FOLLOWER]: Advancing to term 103
I20260620 23:03:37.710934 31963 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.711133 31963 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 103 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:37.711393 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:37.711493 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 103: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:37.711395 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 103 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:37.712160 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 103 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 103.
I20260620 23:03:37.712400 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 103 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:37.712558 31963 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 FOLLOWER]: Leader election won for term 103
I20260620 23:03:37.712647 31963 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:37.712704 31963 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 102.97, Last appended by leader: 97, Current term: 103, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.713195 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 102 to 103, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 103 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:37.735000 31972 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:37.735102 31972 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 103 FOLLOWER]: Advancing to term 104
I20260620 23:03:37.735839 31972 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.736038 31972 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 104 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:37.736315 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 104 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:37.736349 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 104 candidate_status { last_received { term: 102 index: 97 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:37.736387 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 103 FOLLOWER]: Advancing to term 104
I20260620 23:03:37.737063 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 104 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 104.
I20260620 23:03:37.737267 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 104 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:37.737353 31972 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 FOLLOWER]: Leader election won for term 104
I20260620 23:03:37.737407 31972 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:37.737464 31972 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 102.97, Last appended by leader: 97, Current term: 104, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.737907 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 103 to 104, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 104 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:37.760249 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:37.811102 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 103. Current term is 104. Ops: []
I20260620 23:03:37.811430 31963 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260620 23:03:37.811589 31963 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 104.98 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 97
I20260620 23:03:37.811655 31971 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 LEADER]: Stepping down as leader of term 103
I20260620 23:03:37.811738 31971 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:37.811830 31971 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 97, Committed index: 97, Last appended: 103.98, Last appended by leader: 98, Current term: 103, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:37.811954 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 103 FOLLOWER]: Advancing to term 104
I20260620 23:03:37.820199 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 104 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 103 index: 98. Preceding OpId from leader: term: 104 index: 98. (term mismatch)
I20260620 23:03:37.820199 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 104 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 102 index: 97. Preceding OpId from leader: term: 104 index: 98. (index mismatch)
I20260620 23:03:37.820304 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 97
I20260620 23:03:37.820325 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 103.98
I20260620 23:03:37.820355 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 104 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:37.820559 31972 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260620 23:03:37.820710 31970 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 98, Last known committed idx: 97, Time since last communication: 0.000s
I20260620 23:03:38.107880 31969 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 104 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:38.108021 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 104 FOLLOWER]: Advancing to term 105
I20260620 23:03:38.108970 31969 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.109164 31969 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 105 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:38.109365 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 105 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:38.109365 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 105 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:38.109658 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 105 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:38.109809 31969 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Leader election lost for term 105. Reason: could not achieve majority
I20260620 23:03:38.120177 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 104. Current term is 105. Ops: []
I20260620 23:03:38.120442 31974 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 104.98, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260620 23:03:38.120595 31974 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 LEADER]: Stepping down as leader of term 104
I20260620 23:03:38.120638 31974 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:38.120697 31974 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 104.98, Last appended by leader: 98, Current term: 104, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.120793 31974 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 104 FOLLOWER]: Advancing to term 105
I20260620 23:03:38.202733 31971 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 104 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:38.202874 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 104 FOLLOWER]: Advancing to term 105
I20260620 23:03:38.203573 31971 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.203847 31971 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 105 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:38.204031 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 105 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:38.204133 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 105: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:38.204134 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 105 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:38.204984 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 105 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 105.
I20260620 23:03:38.205230 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 105 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:38.205358 31971 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 FOLLOWER]: Leader election won for term 105
I20260620 23:03:38.205435 31971 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:38.205492 31971 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 104.98, Last appended by leader: 98, Current term: 105, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.206051 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 104 to 105, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 105 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:38.214607 31969 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:38.214684 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 105 FOLLOWER]: Advancing to term 106
I20260620 23:03:38.215304 31969 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.215487 31969 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 106 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:38.215701 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 106 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:38.215701 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 106 candidate_status { last_received { term: 104 index: 98 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:38.215811 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 105 FOLLOWER]: Advancing to term 106
I20260620 23:03:38.216442 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 106 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 106.
I20260620 23:03:38.216599 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 106 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:38.216701 31969 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 FOLLOWER]: Leader election won for term 106
I20260620 23:03:38.216804 31969 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:38.216874 31969 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 104.98, Last appended by leader: 98, Current term: 106, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.217307 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 105 to 106, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 106 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:38.283239 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 106 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 105. Current term is 106. Ops: []
I20260620 23:03:38.283550 31971 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260620 23:03:38.283708 31971 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 LEADER]: Stepping down as leader of term 105
I20260620 23:03:38.283747 31971 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:38.283812 31971 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 98, Committed index: 98, Last appended: 105.99, Last appended by leader: 99, Current term: 105, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.283898 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 105 FOLLOWER]: Advancing to term 106
I20260620 23:03:38.302211 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 106 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 105 index: 99. Preceding OpId from leader: term: 106 index: 99. (term mismatch)
I20260620 23:03:38.302309 31728 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 98
I20260620 23:03:38.302325 31728 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 105.99
I20260620 23:03:38.302341 31728 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 106 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:38.302687 31969 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260620 23:03:38.303918 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 106 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 104 index: 98. Preceding OpId from leader: term: 106 index: 99. (index mismatch)
I20260620 23:03:38.304322 31969 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 99, Last known committed idx: 98, Time since last communication: 0.000s
I20260620 23:03:38.656236 31974 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 106 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:38.656394 31974 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 106 FOLLOWER]: Advancing to term 107
I20260620 23:03:38.660372 31971 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 106 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:38.660521 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 106 FOLLOWER]: Advancing to term 107
I20260620 23:03:38.682003 31971 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.682003 31974 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.682215 31728 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 106. Current term is 107. Ops: []
I20260620 23:03:38.682322 31971 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 107 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:38.682456 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 106. Current term is 107. Ops: []
I20260620 23:03:38.682529 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 107 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:38.682699 31974 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 107 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:38.682914 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 107 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:38.682914 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 107 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:38.682999 31975 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 106.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260620 23:03:38.683130 31975 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 106.99, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260620 23:03:38.683012 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 107: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:38.683252 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 107 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:38.683200 31969 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 LEADER]: Stepping down as leader of term 106
I20260620 23:03:38.683403 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 107: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:38.683362 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:38.683416 31969 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:38.683624 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 107 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:38.683552 31974 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260620 23:03:38.683681 31969 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 106.99, Last appended by leader: 99, Current term: 106, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.683722 31971 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Leader election lost for term 107. Reason: could not achieve majority
I20260620 23:03:38.683822 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 106 FOLLOWER]: Advancing to term 107
I20260620 23:03:38.760567 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:38.798365 31971 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:38.798487 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 107 FOLLOWER]: Advancing to term 108
I20260620 23:03:38.803334 31974 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:38.803421 31974 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 107 FOLLOWER]: Advancing to term 108
I20260620 23:03:38.880470 31971 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.880470 31974 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.880769 31974 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 108 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:38.880930 31971 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 108 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:38.880962 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 108 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:38.881040 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 107 FOLLOWER]: Advancing to term 108
I20260620 23:03:38.881090 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 108 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:38.881150 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 108: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:38.881153 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 108 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:38.881340 31728 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 108 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 108: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:38.881503 31803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 108 candidate_status { last_received { term: 106 index: 99 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:38.881709 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 108 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:38.881826 31971 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 108 FOLLOWER]: Leader election lost for term 108. Reason: could not achieve majority
I20260620 23:03:38.881973 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 108 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 108.
I20260620 23:03:38.882153 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 108 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:38.882246 31974 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 FOLLOWER]: Leader election won for term 108
I20260620 23:03:38.882377 31974 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:38.882457 31974 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 99, Committed index: 99, Last appended: 106.99, Last appended by leader: 99, Current term: 108, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:38.882930 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 106 to 108, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 108 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:38.975839 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 108 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 106 index: 99. Preceding OpId from leader: term: 108 index: 100. (index mismatch)
I20260620 23:03:38.976487 31974 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260620 23:03:38.978444 31728 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 108 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 106 index: 99. Preceding OpId from leader: term: 108 index: 100. (index mismatch)
I20260620 23:03:38.978726 31981 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 100, Last known committed idx: 99, Time since last communication: 0.000s
I20260620 23:03:39.078454 31969 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 108 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:39.078581 31969 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 108 FOLLOWER]: Advancing to term 109
I20260620 23:03:39.079682 31969 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.079901 31969 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 109 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:39.080189 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 109 candidate_status { last_received { term: 108 index: 100 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:39.080188 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 109 candidate_status { last_received { term: 108 index: 100 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.080367 31728 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 108 FOLLOWER]: Advancing to term 109
I20260620 23:03:39.081331 31728 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 109 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 109.
I20260620 23:03:39.081475 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 109 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 108. Current term is 109. Ops: []
I20260620 23:03:39.081652 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 109 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:39.081765 31969 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 FOLLOWER]: Leader election won for term 109
I20260620 23:03:39.081732 31977 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 108.100, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260620 23:03:39.081807 31969 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:39.081826 31977 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 LEADER]: Stepping down as leader of term 108
I20260620 23:03:39.081857 31977 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:39.081852 31969 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 108.100, Last appended by leader: 100, Current term: 109, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.081959 31977 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 100, Committed index: 100, Last appended: 108.100, Last appended by leader: 100, Current term: 108, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.082058 31977 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 108 FOLLOWER]: Advancing to term 109
I20260620 23:03:39.082798 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 108 to 109, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 109 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:39.186401 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 109 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 108 index: 100. Preceding OpId from leader: term: 109 index: 101. (index mismatch)
I20260620 23:03:39.186765 31976 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260620 23:03:39.188120 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 109 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 108 index: 100. Preceding OpId from leader: term: 109 index: 101. (index mismatch)
I20260620 23:03:39.188397 31969 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 101, Last known committed idx: 100, Time since last communication: 0.000s
I20260620 23:03:39.289945 31982 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 109 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:39.290048 31982 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 109 FOLLOWER]: Advancing to term 110
I20260620 23:03:39.308454 31977 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 109 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:39.308557 31977 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 109 FOLLOWER]: Advancing to term 110
I20260620 23:03:39.378861 31982 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.378875 31977 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.379057 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 109. Current term is 110. Ops: []
I20260620 23:03:39.379067 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 109. Current term is 110. Ops: []
I20260620 23:03:39.379295 31977 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 110 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:39.379438 31976 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 109.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260620 23:03:39.379462 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 110 candidate_status { last_received { term: 109 index: 101 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.379443 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 110 candidate_status { last_received { term: 109 index: 101 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:39.379562 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 110: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:39.379575 31969 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 109.101, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260620 23:03:39.379698 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 110 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:39.379742 31976 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 LEADER]: Stepping down as leader of term 109
I20260620 23:03:39.379772 31976 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:39.379840 31977 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Leader election lost for term 110. Reason: could not achieve majority
I20260620 23:03:39.379822 31976 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 109.101, Last appended by leader: 101, Current term: 109, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.379922 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 109 FOLLOWER]: Advancing to term 110
I20260620 23:03:39.379992 31982 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 110 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:39.380501 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 110 candidate_status { last_received { term: 109 index: 101 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:39.380754 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 110: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:39.380853 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 110 candidate_status { last_received { term: 109 index: 101 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:39.397831 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 110 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 110.
I20260620 23:03:39.398249 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 110 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:39.398389 31982 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 FOLLOWER]: Leader election won for term 110
I20260620 23:03:39.398476 31982 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:39.398546 31982 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 101, Committed index: 101, Last appended: 109.101, Last appended by leader: 101, Current term: 110, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.399267 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 109 to 110, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 110 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:39.478888 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 110 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 109 index: 101. Preceding OpId from leader: term: 110 index: 102. (index mismatch)
I20260620 23:03:39.479185 31982 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260620 23:03:39.480537 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 109 index: 101. Preceding OpId from leader: term: 110 index: 102. (index mismatch)
I20260620 23:03:39.480777 31982 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 102, Last known committed idx: 101, Time since last communication: 0.000s
I20260620 23:03:39.682117 31981 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:39.682248 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 110 FOLLOWER]: Advancing to term 111
I20260620 23:03:39.760982 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:39.769919 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 110 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:39.770023 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 110 FOLLOWER]: Advancing to term 111
I20260620 23:03:39.776041 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.776041 31981 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.776307 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 110. Current term is 111. Ops: []
I20260620 23:03:39.776357 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 111 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:39.776597 31981 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 111 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:39.776680 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:39.776736 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:39.776760 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 111: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:39.776785 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 111 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 111: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:39.776887 31982 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 110.102, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260620 23:03:39.776930 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.776932 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 111 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.777249 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 111 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:39.777228 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 111 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:39.777351 31976 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 111 FOLLOWER]: Leader election lost for term 111. Reason: could not achieve majority
I20260620 23:03:39.777091 31982 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 LEADER]: Stepping down as leader of term 110
I20260620 23:03:39.777418 31981 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Leader election lost for term 111. Reason: could not achieve majority
I20260620 23:03:39.777458 31982 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:39.777575 31982 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 110.102, Last appended by leader: 102, Current term: 110, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.777683 31982 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 110 FOLLOWER]: Advancing to term 111
I20260620 23:03:39.883008 31981 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:39.883108 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 111 FOLLOWER]: Advancing to term 112
I20260620 23:03:39.892911 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 111 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:39.893011 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 111 FOLLOWER]: Advancing to term 112
I20260620 23:03:39.974673 31981 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.974673 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.975028 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 112 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:39.975042 31981 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 112 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:39.975180 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.975262 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:39.975263 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 111 FOLLOWER]: Advancing to term 112
I20260620 23:03:39.975402 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:39.975349 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 112: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:39.975457 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 112: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:39.975351 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 112 candidate_status { last_received { term: 110 index: 102 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:39.976296 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 112 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:39.976437 31976 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Leader election lost for term 112. Reason: could not achieve majority
I20260620 23:03:39.976476 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 112 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 112.
I20260620 23:03:39.976644 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 112 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:39.976737 31981 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 FOLLOWER]: Leader election won for term 112
I20260620 23:03:39.976805 31981 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:39.976856 31981 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 102, Committed index: 102, Last appended: 110.102, Last appended by leader: 102, Current term: 112, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:39.977316 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 110 to 112, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 112 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:40.055177 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 110 index: 102. Preceding OpId from leader: term: 112 index: 103. (index mismatch)
I20260620 23:03:40.055519 31981 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260620 23:03:40.056806 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 112 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 110 index: 102. Preceding OpId from leader: term: 112 index: 103. (index mismatch)
I20260620 23:03:40.057140 31988 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 103, Last known committed idx: 102, Time since last communication: 0.000s
I20260620 23:03:40.157860 31971 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 112 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:40.157967 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 112 FOLLOWER]: Advancing to term 113
I20260620 23:03:40.158699 31971 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.158897 31971 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 113 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.159142 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.159147 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.159403 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 113 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:40.159507 31971 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Leader election lost for term 113. Reason: could not achieve majority
I20260620 23:03:40.164203 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 112. Current term is 113. Ops: []
I20260620 23:03:40.164445 31988 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 112.103, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260620 23:03:40.164569 31988 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 LEADER]: Stepping down as leader of term 112
I20260620 23:03:40.164595 31988 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:40.164654 31988 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 112, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.164739 31988 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 112 FOLLOWER]: Advancing to term 113
I20260620 23:03:40.236282 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:40.236537 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 112 FOLLOWER]: Advancing to term 113
I20260620 23:03:40.237398 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.237596 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 113 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.237824 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:40.237943 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 113: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:40.237821 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 113 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.238547 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 113 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 113.
I20260620 23:03:40.238802 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 113 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:40.238989 31976 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 FOLLOWER]: Leader election won for term 113
I20260620 23:03:40.239136 31976 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:40.239193 31976 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 113, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.239624 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 112 to 113, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 113 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:40.305398 31971 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:40.305626 31971 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 113 FOLLOWER]: Advancing to term 114
I20260620 23:03:40.307529 31971 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.307741 31971 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 114 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.308028 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 114 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.308023 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 114 candidate_status { last_received { term: 112 index: 103 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.308202 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 113 FOLLOWER]: Advancing to term 114
I20260620 23:03:40.308887 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 114 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 114.
I20260620 23:03:40.309067 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 114 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:40.309178 31971 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 FOLLOWER]: Leader election won for term 114
I20260620 23:03:40.309255 31971 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:40.309317 31971 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 112.103, Last appended by leader: 103, Current term: 114, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.309736 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 113 to 114, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 114 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:40.350200 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 114 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 113. Current term is 114. Ops: []
I20260620 23:03:40.350498 31976 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260620 23:03:40.350643 31976 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 LEADER]: Stepping down as leader of term 113
I20260620 23:03:40.350700 31976 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:40.350768 31976 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 103, Committed index: 103, Last appended: 113.104, Last appended by leader: 104, Current term: 113, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.350890 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 113 FOLLOWER]: Advancing to term 114
I20260620 23:03:40.390651 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 114 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 113 index: 104. Preceding OpId from leader: term: 114 index: 104. (term mismatch)
I20260620 23:03:40.390797 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 103
I20260620 23:03:40.390828 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 113.104
I20260620 23:03:40.390863 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 114 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:40.391126 31971 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260620 23:03:40.392339 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 114 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 112 index: 103. Preceding OpId from leader: term: 114 index: 104. (index mismatch)
I20260620 23:03:40.392627 31990 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 104, Last known committed idx: 103, Time since last communication: 0.000s
I20260620 23:03:40.493193 31988 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 114 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:40.493278 31988 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 114 FOLLOWER]: Advancing to term 115
I20260620 23:03:40.493955 31988 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.494128 31988 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 115 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:40.494287 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 115 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.494374 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 115 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:40.494596 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 115 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:40.494716 31988 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Leader election lost for term 115. Reason: could not achieve majority
I20260620 23:03:40.516237 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 114. Current term is 115. Ops: []
I20260620 23:03:40.516543 31982 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 114.104, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260620 23:03:40.516682 31982 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 LEADER]: Stepping down as leader of term 114
I20260620 23:03:40.516718 31982 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:40.516840 31982 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 114.104, Last appended by leader: 104, Current term: 114, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.516937 31982 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 114 FOLLOWER]: Advancing to term 115
I20260620 23:03:40.592756 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 114 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:40.592870 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 114 FOLLOWER]: Advancing to term 115
I20260620 23:03:40.593582 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.593811 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 115 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.594030 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 115 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:40.594101 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 115 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.594249 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 115: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:40.594779 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 115 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 115.
I20260620 23:03:40.595041 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 115 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:40.595177 31976 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 FOLLOWER]: Leader election won for term 115
I20260620 23:03:40.595264 31976 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:40.595335 31976 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 114.104, Last appended by leader: 104, Current term: 115, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.595853 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 114 to 115, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 115 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:40.643764 31988 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:40.643879 31988 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 115 FOLLOWER]: Advancing to term 116
I20260620 23:03:40.644701 31988 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.644927 31988 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 116 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:40.645166 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 116 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.645191 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 116 candidate_status { last_received { term: 114 index: 104 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:40.645318 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 115 FOLLOWER]: Advancing to term 116
I20260620 23:03:40.645855 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 116 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 116.
I20260620 23:03:40.646045 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 116 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:40.646152 31988 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 FOLLOWER]: Leader election won for term 116
I20260620 23:03:40.646200 31988 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:40.646270 31988 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 114.104, Last appended by leader: 104, Current term: 116, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.646756 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 115 to 116, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 116 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:40.700588 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 116 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 115. Current term is 116. Ops: []
I20260620 23:03:40.700971 31976 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260620 23:03:40.701126 31976 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 LEADER]: Stepping down as leader of term 115
I20260620 23:03:40.701146 31976 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:40.701258 31976 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 104, Committed index: 104, Last appended: 115.105, Last appended by leader: 105, Current term: 115, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.701375 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 115 FOLLOWER]: Advancing to term 116
I20260620 23:03:40.732657 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 116 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 115 index: 105. Preceding OpId from leader: term: 116 index: 105. (term mismatch)
I20260620 23:03:40.732738 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 104
I20260620 23:03:40.732751 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 115.105
I20260620 23:03:40.732767 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 116 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:40.733119 31988 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260620 23:03:40.734378 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 116 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 114 index: 104. Preceding OpId from leader: term: 116 index: 105. (index mismatch)
I20260620 23:03:40.734630 31991 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 105, Last known committed idx: 104, Time since last communication: 0.000s
I20260620 23:03:40.761284 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:40.835458 31982 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 116 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:40.835587 31982 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 116 FOLLOWER]: Advancing to term 117
I20260620 23:03:40.836422 31982 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.836644 31982 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 117 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.836848 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 117 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.837028 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 117 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.837355 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 117 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:40.837450 31982 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Leader election lost for term 117. Reason: could not achieve majority
I20260620 23:03:40.858135 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 116. Current term is 117. Ops: []
I20260620 23:03:40.858435 31991 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 116.105, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260620 23:03:40.858589 31981 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 LEADER]: Stepping down as leader of term 116
I20260620 23:03:40.858646 31981 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:40.858724 31981 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 116.105, Last appended by leader: 105, Current term: 116, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.858814 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 116 FOLLOWER]: Advancing to term 117
I20260620 23:03:40.926671 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 116 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:40.926831 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 116 FOLLOWER]: Advancing to term 117
I20260620 23:03:40.927524 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.927748 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 117 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.928002 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 117 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.928002 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 117 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:40.928172 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 117: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:40.928787 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 117 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 117.
I20260620 23:03:40.928949 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 117 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:40.929033 31976 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 FOLLOWER]: Leader election won for term 117
I20260620 23:03:40.929102 31976 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:40.929154 31976 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 116.105, Last appended by leader: 105, Current term: 117, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.929623 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 116 to 117, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 117 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:40.946673 31982 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:40.946779 31982 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 117 FOLLOWER]: Advancing to term 118
I20260620 23:03:40.947574 31982 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.947759 31982 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 118 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:40.947999 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 118 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:40.948105 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 117 FOLLOWER]: Advancing to term 118
I20260620 23:03:40.948004 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 118 candidate_status { last_received { term: 116 index: 105 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:40.948693 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 118 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 118.
I20260620 23:03:40.948930 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 118 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:40.949051 31982 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 FOLLOWER]: Leader election won for term 118
I20260620 23:03:40.949120 31982 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:40.949292 31982 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 116.105, Last appended by leader: 105, Current term: 118, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:40.949860 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 117 to 118, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 118 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:41.012296 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 118 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 117. Current term is 118. Ops: []
I20260620 23:03:41.012630 31976 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260620 23:03:41.012786 31976 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 LEADER]: Stepping down as leader of term 117
I20260620 23:03:41.012844 31976 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:41.012913 31976 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 105, Committed index: 105, Last appended: 117.106, Last appended by leader: 106, Current term: 117, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.013015 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 117 FOLLOWER]: Advancing to term 118
I20260620 23:03:41.034435 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 118 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 116 index: 105. Preceding OpId from leader: term: 118 index: 106. (index mismatch)
I20260620 23:03:41.034703 31982 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260620 23:03:41.035889 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 118 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 117 index: 106. Preceding OpId from leader: term: 118 index: 106. (term mismatch)
I20260620 23:03:41.035945 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 105
I20260620 23:03:41.035965 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 117.106
I20260620 23:03:41.035992 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 118 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:41.036159 31992 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 106, Last known committed idx: 105, Time since last communication: 0.000s
I20260620 23:03:41.136812 31981 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 118 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:41.136981 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 118 FOLLOWER]: Advancing to term 119
I20260620 23:03:41.137663 31981 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.137859 31981 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 119 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:41.138047 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 119 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:41.138070 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 119 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.138334 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 119 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:41.138434 31981 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Leader election lost for term 119. Reason: could not achieve majority
I20260620 23:03:41.154116 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 118. Current term is 119. Ops: []
I20260620 23:03:41.154428 31982 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 118.106, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260620 23:03:41.154570 31990 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 LEADER]: Stepping down as leader of term 118
I20260620 23:03:41.154621 31990 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:41.154670 31990 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 118.106, Last appended by leader: 106, Current term: 118, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.154778 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 118 FOLLOWER]: Advancing to term 119
I20260620 23:03:41.237998 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 118 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:41.238097 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 118 FOLLOWER]: Advancing to term 119
I20260620 23:03:41.238867 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.239058 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 119 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:41.239310 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 119 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.239312 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 119 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:41.239467 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 119: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:41.240114 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 119 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 119.
I20260620 23:03:41.240286 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 119 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:41.240417 31976 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 FOLLOWER]: Leader election won for term 119
I20260620 23:03:41.240473 31976 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:41.240528 31976 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 118.106, Last appended by leader: 106, Current term: 119, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.241021 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 118 to 119, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 119 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:41.274031 31981 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:41.274139 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 119 FOLLOWER]: Advancing to term 120
I20260620 23:03:41.274863 31981 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.275079 31981 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 120 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:41.275326 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 120 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.275336 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 120 candidate_status { last_received { term: 118 index: 106 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:41.275420 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 119 FOLLOWER]: Advancing to term 120
I20260620 23:03:41.276160 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 120 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 120.
I20260620 23:03:41.276362 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 120 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:41.276481 31981 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 FOLLOWER]: Leader election won for term 120
I20260620 23:03:41.276580 31981 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:41.276666 31981 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 118.106, Last appended by leader: 106, Current term: 120, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.277145 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 119 to 120, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 120 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:41.351089 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 120 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 119. Current term is 120. Ops: []
I20260620 23:03:41.351491 31976 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260620 23:03:41.351634 31976 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 LEADER]: Stepping down as leader of term 119
I20260620 23:03:41.351672 31976 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:41.351780 31976 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 106, Committed index: 106, Last appended: 119.107, Last appended by leader: 107, Current term: 119, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.351862 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 119 FOLLOWER]: Advancing to term 120
I20260620 23:03:41.376957 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 120 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 118 index: 106. Preceding OpId from leader: term: 120 index: 107. (index mismatch)
I20260620 23:03:41.377364 31991 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260620 23:03:41.377588 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 120 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 119 index: 107. Preceding OpId from leader: term: 120 index: 107. (term mismatch)
I20260620 23:03:41.377653 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 106
I20260620 23:03:41.377676 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 119.107
I20260620 23:03:41.377779 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 120 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:41.377990 31991 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 107, Last known committed idx: 106, Time since last communication: 0.000s
I20260620 23:03:41.479369 31990 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 120 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:41.479471 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 120 FOLLOWER]: Advancing to term 121
I20260620 23:03:41.480253 31990 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.480451 31990 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 121 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:41.480746 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 121 candidate_status { last_received { term: 120 index: 107 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:41.480880 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 120 FOLLOWER]: Advancing to term 121
I20260620 23:03:41.480762 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 121 candidate_status { last_received { term: 120 index: 107 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:41.481753 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 121 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 121.
I20260620 23:03:41.481964 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 121 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:41.482097 31990 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 FOLLOWER]: Leader election won for term 121
I20260620 23:03:41.482156 31990 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:41.482205 31990 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 120.107, Last appended by leader: 107, Current term: 121, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.482688 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 120 to 121, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 121 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:41.484686 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 121 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 120. Current term is 121. Ops: []
I20260620 23:03:41.484930 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 LEADER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 120. Current term is 121. Ops: []
I20260620 23:03:41.484946 31994 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 120.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260620 23:03:41.485111 31981 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 LEADER]: Stepping down as leader of term 120
I20260620 23:03:41.485131 31994 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 120.107, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260620 23:03:41.485157 31981 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:41.485205 31994 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 121.108 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 107
I20260620 23:03:41.485273 31981 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 107, Committed index: 107, Last appended: 120.107, Last appended by leader: 107, Current term: 120, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.485385 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 120 FOLLOWER]: Advancing to term 121
I20260620 23:03:41.560379 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 121 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 120 index: 107. Preceding OpId from leader: term: 121 index: 108. (index mismatch)
I20260620 23:03:41.560746 31990 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260620 23:03:41.561925 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 121 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 120 index: 107. Preceding OpId from leader: term: 121 index: 108. (index mismatch)
I20260620 23:03:41.562288 31990 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 108, Last known committed idx: 107, Time since last communication: 0.000s
I20260620 23:03:41.755499 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 121 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:41.755606 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 121 FOLLOWER]: Advancing to term 122
I20260620 23:03:41.756476 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.756664 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 122 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:41.756920 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 122 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:41.756927 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 122 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.757246 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 122 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:41.757388 31976 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Leader election lost for term 122. Reason: could not achieve majority
I20260620 23:03:41.761543 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:41.764549 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 121. Current term is 122. Ops: []
I20260620 23:03:41.764847 31992 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 121.108, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260620 23:03:41.765084 31990 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 LEADER]: Stepping down as leader of term 121
I20260620 23:03:41.765128 31990 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:41.765216 31990 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 121.108, Last appended by leader: 108, Current term: 121, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.765308 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 121 FOLLOWER]: Advancing to term 122
I20260620 23:03:41.782416 31981 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 121 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:41.782518 31981 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 121 FOLLOWER]: Advancing to term 122
I20260620 23:03:41.783205 31981 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.783417 31981 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 122 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:41.783620 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 122 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:41.783736 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 122: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:41.783680 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 122 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.784514 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 122 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 122.
I20260620 23:03:41.784789 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 122 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:41.784929 31981 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 FOLLOWER]: Leader election won for term 122
I20260620 23:03:41.785019 31981 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:41.785084 31981 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 108, Committed index: 108, Last appended: 121.108, Last appended by leader: 108, Current term: 122, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.785585 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 121 to 122, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 122 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:41.874464 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 122 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 121 index: 108. Preceding OpId from leader: term: 122 index: 109. (index mismatch)
I20260620 23:03:41.874768 31981 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260620 23:03:41.874946 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:41.875000 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 122 FOLLOWER]: Advancing to term 123
I20260620 23:03:41.875737 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.875931 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 123 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:41.876106 31728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 123 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:41.876142 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 123 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:41.876340 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 123 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:41.876454 31976 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Leader election lost for term 123. Reason: could not achieve majority
I20260620 23:03:41.876744 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 122. Current term is 123. Ops: []
I20260620 23:03:41.876950 31994 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 109, Last known committed idx: 108, Time since last communication: 0.000s
I20260620 23:03:41.877182 31991 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 LEADER]: Stepping down as leader of term 122
I20260620 23:03:41.877236 31991 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:41.877290 31991 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 122.109, Last appended by leader: 109, Current term: 122, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.877379 31991 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 122 FOLLOWER]: Advancing to term 123
I20260620 23:03:41.990868 31990 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 122 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:41.990972 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 122 FOLLOWER]: Advancing to term 123
I20260620 23:03:41.991716 31990 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.991925 31990 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 123 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:41.992170 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 123 candidate_status { last_received { term: 122 index: 109 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:41.992873 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 123 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 123.
I20260620 23:03:41.993006 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 123 candidate_status { last_received { term: 122 index: 109 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:41.993075 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 123: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:41.993073 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 123 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:41.993191 31990 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 FOLLOWER]: Leader election won for term 123
I20260620 23:03:41.993268 31990 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:41.993323 31990 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 122.109, Last appended by leader: 109, Current term: 123, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:41.993798 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 122 to 123, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 123 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:42.084264 31976 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:42.084419 31976 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 123 FOLLOWER]: Advancing to term 124
I20260620 23:03:42.085323 31976 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 124 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.085572 31976 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 124 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:42.085870 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 124 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:42.085850 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 124 candidate_status { last_received { term: 121 index: 108 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.085976 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 123 FOLLOWER]: Advancing to term 124
I20260620 23:03:42.086647 31652 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 124 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece for term 124 because replica has last-logged OpId of term: 122 index: 109, which is greater than that of the candidate, which has last-logged OpId of term: 121 index: 108.
I20260620 23:03:42.086880 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 124 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:42.086989 31976 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 124 FOLLOWER]: Leader election lost for term 124. Reason: could not achieve majority
I20260620 23:03:42.094442 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 124 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 123. Current term is 124. Ops: []
I20260620 23:03:42.094754 31990 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 110, Last known committed idx: 108, Time since last communication: 0.000s
I20260620 23:03:42.094938 31990 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 LEADER]: Stepping down as leader of term 123
I20260620 23:03:42.094995 31990 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:42.095062 31990 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 123.110, Last appended by leader: 110, Current term: 123, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.095152 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 123 FOLLOWER]: Advancing to term 124
I20260620 23:03:42.103936 31991 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 124 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:42.104030 31991 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 124 FOLLOWER]: Advancing to term 125
I20260620 23:03:42.104768 31991 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.104974 31991 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 125 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:42.105181 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 125 candidate_status { last_received { term: 122 index: 109 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.105275 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 124 FOLLOWER]: Advancing to term 125
I20260620 23:03:42.105230 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 125 candidate_status { last_received { term: 122 index: 109 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:42.105347 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 124 FOLLOWER]: Advancing to term 125
I20260620 23:03:42.105908 31727 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 125 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for term 125 because replica has last-logged OpId of term: 123 index: 110, which is greater than that of the candidate, which has last-logged OpId of term: 122 index: 109.
I20260620 23:03:42.105989 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 125 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 125.
I20260620 23:03:42.106164 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 125 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:42.106268 31991 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 FOLLOWER]: Leader election won for term 125
I20260620 23:03:42.106379 31991 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:42.106455 31991 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 109, Committed index: 109, Last appended: 122.109, Last appended by leader: 109, Current term: 125, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.106961 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 123 to 125, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 125 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:42.201773 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 125 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 123 index: 110. Preceding OpId from leader: term: 125 index: 110. (term mismatch)
I20260620 23:03:42.201872 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 109
I20260620 23:03:42.201892 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 123.110
I20260620 23:03:42.201918 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 125 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:42.202203 31991 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 109, Time since last communication: 0.000s
I20260620 23:03:42.203580 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 125 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 121 index: 108. Preceding OpId from leader: term: 125 index: 110. (index mismatch)
I20260620 23:03:42.203761 31994 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 110, Last known committed idx: 108, Time since last communication: 0.000s
I20260620 23:03:42.380460 31990 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 125 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:42.380574 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 125 FOLLOWER]: Advancing to term 126
I20260620 23:03:42.381275 31990 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.381532 31990 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 126 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:42.381794 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 126 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:42.381815 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 126 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:42.382087 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 126 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:42.382200 31990 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Leader election lost for term 126. Reason: could not achieve majority
I20260620 23:03:42.389286 31995 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 125 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:42.389382 31995 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 125 FOLLOWER]: Advancing to term 126
I20260620 23:03:42.390142 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 125. Current term is 126. Ops: []
I20260620 23:03:42.390189 31995 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 126 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.390370 31995 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 126 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:42.390400 31991 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 125.110, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260620 23:03:42.390522 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 126 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:42.390529 31994 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 LEADER]: Stepping down as leader of term 125
I20260620 23:03:42.390679 31994 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:42.390686 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 126 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.390782 31994 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 125.110, Last appended by leader: 110, Current term: 125, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.390847 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 126: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:42.390956 31994 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 125 FOLLOWER]: Advancing to term 126
I20260620 23:03:42.391052 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 126 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:42.391148 31995 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 126 FOLLOWER]: Leader election lost for term 126. Reason: could not achieve majority
I20260620 23:03:42.520449 31990 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:42.520552 31990 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 126 FOLLOWER]: Advancing to term 127
I20260620 23:03:42.521281 31990 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.521477 31990 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 127 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:42.521858 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 127 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:42.521968 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 126 FOLLOWER]: Advancing to term 127
I20260620 23:03:42.521863 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 127 candidate_status { last_received { term: 125 index: 110 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:42.522064 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 126 FOLLOWER]: Advancing to term 127
I20260620 23:03:42.522578 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 127 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 127.
I20260620 23:03:42.522606 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 127 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 127.
I20260620 23:03:42.522804 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 127 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: 
I20260620 23:03:42.522891 31990 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 FOLLOWER]: Leader election won for term 127
I20260620 23:03:42.522940 31990 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:42.522991 31990 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 110, Committed index: 110, Last appended: 125.110, Last appended by leader: 110, Current term: 127, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.523878 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 125 to 127, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 127 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:42.607851 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 127 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 125 index: 110. Preceding OpId from leader: term: 127 index: 111. (index mismatch)
I20260620 23:03:42.608189 31990 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260620 23:03:42.609659 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 127 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 125 index: 110. Preceding OpId from leader: term: 127 index: 111. (index mismatch)
I20260620 23:03:42.609953 31997 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 111, Last known committed idx: 110, Time since last communication: 0.000s
I20260620 23:03:42.711194 31994 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 127 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:42.711301 31994 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 127 FOLLOWER]: Advancing to term 128
I20260620 23:03:42.712306 31994 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.712496 31994 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 128 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:42.712731 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 128 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:42.712731 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 128 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.713018 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 128 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:42.713166 31994 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Leader election lost for term 128. Reason: could not achieve majority
I20260620 23:03:42.713575 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 127. Current term is 128. Ops: []
I20260620 23:03:42.713912 31997 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 127.111, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260620 23:03:42.714020 31997 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 LEADER]: Stepping down as leader of term 127
I20260620 23:03:42.714041 31997 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:42.714095 31997 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 127.111, Last appended by leader: 111, Current term: 127, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.714177 31997 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 127 FOLLOWER]: Advancing to term 128
I20260620 23:03:42.761876 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:42.788527 31995 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 127 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:42.788666 31995 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 127 FOLLOWER]: Advancing to term 128
I20260620 23:03:42.789404 31995 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.789623 31995 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 128 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:42.789876 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 128 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:42.789961 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 128: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:42.789937 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 128 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.790683 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 128 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 128.
I20260620 23:03:42.790885 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 128 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:42.791000 31995 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 FOLLOWER]: Leader election won for term 128
I20260620 23:03:42.791141 31995 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:42.791203 31995 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 127.111, Last appended by leader: 111, Current term: 128, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.791720 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 127 to 128, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 128 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:42.839777 31994 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:42.839895 31994 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 128 FOLLOWER]: Advancing to term 129
I20260620 23:03:42.840793 31994 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.841174 31994 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 129 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:42.841253 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 129 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:42.841445 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 129 candidate_status { last_received { term: 127 index: 111 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:42.841603 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 128 FOLLOWER]: Advancing to term 129
I20260620 23:03:42.842586 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 129 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 129.
I20260620 23:03:42.842793 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 129 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:42.842952 31994 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 FOLLOWER]: Leader election won for term 129
I20260620 23:03:42.843046 31994 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:42.843143 31994 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 127.111, Last appended by leader: 111, Current term: 129, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.843799 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 128 to 129, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 129 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:42.888866 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 LEADER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 128. Current term is 129. Ops: []
I20260620 23:03:42.889246 31995 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260620 23:03:42.889405 31995 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer e958ff05bd794a0496045351b3a629d9 log is divergent from this leader: its last log entry 129.112 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 111
I20260620 23:03:42.889449 31998 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 LEADER]: Stepping down as leader of term 128
I20260620 23:03:42.889526 31998 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:42.889605 31998 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 111, Committed index: 111, Last appended: 128.112, Last appended by leader: 112, Current term: 128, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:42.889724 31998 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 128 FOLLOWER]: Advancing to term 129
I20260620 23:03:42.919690 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 129 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 128 index: 112. Preceding OpId from leader: term: 129 index: 112. (term mismatch)
I20260620 23:03:42.919767 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 111
I20260620 23:03:42.919786 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 128.112
I20260620 23:03:42.919803 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 129 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:42.920112 31994 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260620 23:03:42.921144 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 129 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 127 index: 111. Preceding OpId from leader: term: 129 index: 112. (index mismatch)
I20260620 23:03:42.921341 31994 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 112, Last known committed idx: 111, Time since last communication: 0.000s
I20260620 23:03:43.021831 31997 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 129 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:43.021932 31997 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 129 FOLLOWER]: Advancing to term 130
I20260620 23:03:43.022616 31997 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.022837 31997 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 130 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:43.023069 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:43.023069 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 130 candidate_status { last_received { term: 129 index: 112 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:43.023208 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 129 FOLLOWER]: Advancing to term 130
I20260620 23:03:43.023782 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 130 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 130.
I20260620 23:03:43.023986 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 130 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:43.024108 31997 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 FOLLOWER]: Leader election won for term 130
I20260620 23:03:43.024171 31997 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:43.024228 31997 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 129.112, Last appended by leader: 112, Current term: 130, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.024693 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 129 to 130, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 130 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:43.033644 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 130 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 129. Current term is 130. Ops: []
I20260620 23:03:43.033912 31994 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 129.112, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260620 23:03:43.034030 31994 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 LEADER]: Stepping down as leader of term 129
I20260620 23:03:43.034066 31994 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:43.034126 31994 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 112, Committed index: 112, Last appended: 129.112, Last appended by leader: 112, Current term: 129, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.034204 31994 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 129 FOLLOWER]: Advancing to term 130
I20260620 23:03:43.105561 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 130 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 129 index: 112. Preceding OpId from leader: term: 130 index: 113. (index mismatch)
I20260620 23:03:43.105922 31997 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260620 23:03:43.107106 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 130 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 129 index: 112. Preceding OpId from leader: term: 130 index: 113. (index mismatch)
I20260620 23:03:43.107358 31996 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 113, Last known committed idx: 112, Time since last communication: 0.000s
I20260620 23:03:43.208217 31998 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 130 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:43.208343 31998 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 130 FOLLOWER]: Advancing to term 131
I20260620 23:03:43.209096 31998 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.209338 31998 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 131 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:43.209540 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 131 candidate_status { last_received { term: 130 index: 113 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:43.209544 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 131 candidate_status { last_received { term: 130 index: 113 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:43.209682 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 130 FOLLOWER]: Advancing to term 131
I20260620 23:03:43.210343 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 131 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 131.
I20260620 23:03:43.210494 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 131 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:43.210552 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 131 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 130. Current term is 131. Ops: []
I20260620 23:03:43.210605 31998 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 FOLLOWER]: Leader election won for term 131
I20260620 23:03:43.210659 31998 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:43.210733 31998 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 130.113, Last appended by leader: 113, Current term: 131, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.210731 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 130.113, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260620 23:03:43.210847 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 LEADER]: Stepping down as leader of term 130
I20260620 23:03:43.210881 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:43.210922 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 113, Committed index: 113, Last appended: 130.113, Last appended by leader: 113, Current term: 130, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.211007 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 130 FOLLOWER]: Advancing to term 131
I20260620 23:03:43.211232 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 130 to 131, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 131 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:43.332459 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 131 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 130 index: 113. Preceding OpId from leader: term: 131 index: 114. (index mismatch)
I20260620 23:03:43.332846 31995 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260620 23:03:43.333091 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 131 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 130 index: 113. Preceding OpId from leader: term: 131 index: 114. (index mismatch)
I20260620 23:03:43.333487 31995 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 114, Last known committed idx: 113, Time since last communication: 0.000s
I20260620 23:03:43.434336 31994 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 131 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:43.434448 31994 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 131 FOLLOWER]: Advancing to term 132
I20260620 23:03:43.435181 31994 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.435389 31994 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 132 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:43.435655 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 132 candidate_status { last_received { term: 131 index: 114 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:43.435665 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 132 candidate_status { last_received { term: 131 index: 114 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:43.435752 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 131 FOLLOWER]: Advancing to term 132
I20260620 23:03:43.436496 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 132 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 132.
I20260620 23:03:43.436726 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 132 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:43.436818 31994 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 FOLLOWER]: Leader election won for term 132
I20260620 23:03:43.436901 31994 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:43.436961 31994 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 131.114, Last appended by leader: 114, Current term: 132, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.437451 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 131 to 132, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 132 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:43.440377 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 132 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 131. Current term is 132. Ops: []
I20260620 23:03:43.440603 31995 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 131.114, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260620 23:03:43.440738 31999 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 LEADER]: Stepping down as leader of term 131
I20260620 23:03:43.440786 31999 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:43.440831 31999 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 114, Committed index: 114, Last appended: 131.114, Last appended by leader: 114, Current term: 131, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.440934 31999 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 131 FOLLOWER]: Advancing to term 132
I20260620 23:03:43.530326 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 132 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 131 index: 114. Preceding OpId from leader: term: 132 index: 115. (index mismatch)
I20260620 23:03:43.530720 31994 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260620 23:03:43.532100 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 132 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 131 index: 114. Preceding OpId from leader: term: 132 index: 115. (index mismatch)
I20260620 23:03:43.532366 31994 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 115, Last known committed idx: 114, Time since last communication: 0.000s
I20260620 23:03:43.755159 31999 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 132 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:43.755265 31999 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 132 FOLLOWER]: Advancing to term 133
I20260620 23:03:43.756069 31999 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.756312 31999 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 133 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:43.756556 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 133 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:43.756567 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 133 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:43.756844 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 133 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:43.757014 31999 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Leader election lost for term 133. Reason: could not achieve majority
I20260620 23:03:43.762187 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:43.776927 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 132. Current term is 133. Ops: []
I20260620 23:03:43.777287 32000 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 132.115, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260620 23:03:43.777455 31991 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 LEADER]: Stepping down as leader of term 132
I20260620 23:03:43.777504 31991 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:43.777572 31991 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 132.115, Last appended by leader: 115, Current term: 132, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.777660 31991 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 132 FOLLOWER]: Advancing to term 133
I20260620 23:03:43.807454 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 132 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:43.807566 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 132 FOLLOWER]: Advancing to term 133
I20260620 23:03:43.808354 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.808558 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 133 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:43.808825 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 133 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:43.808825 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 133 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:43.808990 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 133: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:43.809638 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 133 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 133.
I20260620 23:03:43.809823 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 133 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:43.809913 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 FOLLOWER]: Leader election won for term 133
I20260620 23:03:43.810037 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:43.810099 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 132.115, Last appended by leader: 115, Current term: 133, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.810523 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 132 to 133, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 133 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:43.867650 31999 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:43.867750 31999 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 133 FOLLOWER]: Advancing to term 134
I20260620 23:03:43.868680 31999 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.868876 31999 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 134 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:43.869077 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 134 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:43.869133 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 134 candidate_status { last_received { term: 132 index: 115 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:43.869220 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 133 FOLLOWER]: Advancing to term 134
I20260620 23:03:43.869777 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 134 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 134.
I20260620 23:03:43.869967 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 134 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:43.870072 31999 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 FOLLOWER]: Leader election won for term 134
I20260620 23:03:43.870137 31999 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:43.870190 31999 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 132.115, Last appended by leader: 115, Current term: 134, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.870680 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 133 to 134, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 134 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:43.898293 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 133. Current term is 134. Ops: []
I20260620 23:03:43.898628 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260620 23:03:43.898765 31996 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 134.116 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 115
I20260620 23:03:43.898801 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 LEADER]: Stepping down as leader of term 133
I20260620 23:03:43.898841 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:43.898914 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 115, Committed index: 115, Last appended: 133.116, Last appended by leader: 116, Current term: 133, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:43.898995 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 133 FOLLOWER]: Advancing to term 134
I20260620 23:03:43.949494 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 134 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 133 index: 116. Preceding OpId from leader: term: 134 index: 116. (term mismatch)
I20260620 23:03:43.949572 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 115
I20260620 23:03:43.949585 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 133.116
I20260620 23:03:43.949601 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 134 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:43.949904 31999 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260620 23:03:43.951099 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 134 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 132 index: 115. Preceding OpId from leader: term: 134 index: 116. (index mismatch)
I20260620 23:03:43.951326 31999 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 116, Last known committed idx: 115, Time since last communication: 0.000s
I20260620 23:03:44.051777 31991 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 134 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:44.051889 31991 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 134 FOLLOWER]: Advancing to term 135
I20260620 23:03:44.052652 31991 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.052839 31991 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 135 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:44.052997 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 135 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.053064 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 135 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.053233 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 135 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:44.053413 31991 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Leader election lost for term 135. Reason: could not achieve majority
I20260620 23:03:44.074416 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 134. Current term is 135. Ops: []
I20260620 23:03:44.074700 31995 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 134.116, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260620 23:03:44.074857 31995 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 LEADER]: Stepping down as leader of term 134
I20260620 23:03:44.074887 31995 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:44.074940 31995 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 134.116, Last appended by leader: 116, Current term: 134, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.075026 31995 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 134 FOLLOWER]: Advancing to term 135
I20260620 23:03:44.139576 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 134 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:44.139729 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 134 FOLLOWER]: Advancing to term 135
I20260620 23:03:44.140606 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.140800 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 135 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:44.141036 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 135 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:44.141036 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 135 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.141189 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 135: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:44.141811 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 135 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 135.
I20260620 23:03:44.142042 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 135 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:44.142153 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 FOLLOWER]: Leader election won for term 135
I20260620 23:03:44.142246 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.142307 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 134.116, Last appended by leader: 116, Current term: 135, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.142776 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 134 to 135, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 135 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:44.185789 31991 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:44.185895 31991 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 135 FOLLOWER]: Advancing to term 136
I20260620 23:03:44.186650 31991 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.186939 31991 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 136 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:44.187191 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 136 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.187201 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 136 candidate_status { last_received { term: 134 index: 116 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.187356 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 135 FOLLOWER]: Advancing to term 136
I20260620 23:03:44.187923 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 136 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 136.
I20260620 23:03:44.188134 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 136 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:44.188241 31991 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 FOLLOWER]: Leader election won for term 136
I20260620 23:03:44.188333 31991 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:44.188412 31991 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 134.116, Last appended by leader: 116, Current term: 136, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.188922 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 135 to 136, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 136 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:44.240293 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 136 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 135. Current term is 136. Ops: []
I20260620 23:03:44.240657 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260620 23:03:44.240830 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 LEADER]: Stepping down as leader of term 135
I20260620 23:03:44.240880 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.240943 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 116, Committed index: 116, Last appended: 135.117, Last appended by leader: 117, Current term: 135, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.241022 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 135 FOLLOWER]: Advancing to term 136
I20260620 23:03:44.285650 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 136 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 135 index: 117. Preceding OpId from leader: term: 136 index: 117. (term mismatch)
I20260620 23:03:44.285741 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 116
I20260620 23:03:44.285756 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 135.117
I20260620 23:03:44.285772 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 136 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:44.286010 31991 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260620 23:03:44.287020 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 136 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 134 index: 116. Preceding OpId from leader: term: 136 index: 117. (index mismatch)
I20260620 23:03:44.287240 32003 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 117, Last known committed idx: 116, Time since last communication: 0.000s
I20260620 23:03:44.387691 31995 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 136 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:44.387835 31995 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 136 FOLLOWER]: Advancing to term 137
I20260620 23:03:44.388628 31995 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.388849 31995 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 137 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:44.389068 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 137 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.389068 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 137 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:44.389358 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 137 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:44.389462 31995 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Leader election lost for term 137. Reason: could not achieve majority
I20260620 23:03:44.410158 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 136. Current term is 137. Ops: []
I20260620 23:03:44.410459 32000 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 136.117, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260620 23:03:44.410578 32000 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 LEADER]: Stepping down as leader of term 136
I20260620 23:03:44.410667 32000 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:44.410733 32000 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 136.117, Last appended by leader: 117, Current term: 136, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.410853 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 136 FOLLOWER]: Advancing to term 137
I20260620 23:03:44.469167 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 136 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:44.469326 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 136 FOLLOWER]: Advancing to term 137
I20260620 23:03:44.470026 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.470232 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 137 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:44.470466 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 137 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.470541 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 137: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:44.470489 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 137 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:44.471184 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 137 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 137.
I20260620 23:03:44.471457 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 137 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:44.471589 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 FOLLOWER]: Leader election won for term 137
I20260620 23:03:44.471709 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.471799 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 136.117, Last appended by leader: 117, Current term: 137, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.472347 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 136 to 137, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 137 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:44.516218 31995 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:44.516345 31995 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 137 FOLLOWER]: Advancing to term 138
I20260620 23:03:44.517015 31995 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.517220 31995 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 138 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:44.517459 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 138 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.517470 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 138 candidate_status { last_received { term: 136 index: 117 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:44.517567 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 137 FOLLOWER]: Advancing to term 138
I20260620 23:03:44.518181 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 138 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 138.
I20260620 23:03:44.518365 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 138 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:44.518450 31995 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 FOLLOWER]: Leader election won for term 138
I20260620 23:03:44.518522 31995 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:44.518579 31995 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 136.117, Last appended by leader: 117, Current term: 138, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.519016 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 137 to 138, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 138 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:44.560254 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 138 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 137. Current term is 138. Ops: []
I20260620 23:03:44.560552 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260620 23:03:44.560674 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 LEADER]: Stepping down as leader of term 137
I20260620 23:03:44.560691 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.560760 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 117, Committed index: 117, Last appended: 137.118, Last appended by leader: 118, Current term: 137, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.560868 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 137 FOLLOWER]: Advancing to term 138
I20260620 23:03:44.612690 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 138 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 136 index: 117. Preceding OpId from leader: term: 138 index: 118. (index mismatch)
I20260620 23:03:44.612986 31995 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260620 23:03:44.614020 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 138 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 137 index: 118. Preceding OpId from leader: term: 138 index: 118. (term mismatch)
I20260620 23:03:44.614074 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 117
I20260620 23:03:44.614094 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 137.118
I20260620 23:03:44.614112 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 138 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:44.614295 32004 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 118, Last known committed idx: 117, Time since last communication: 0.000s
I20260620 23:03:44.762404 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:44.795409 32000 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 138 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:44.795521 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 138 FOLLOWER]: Advancing to term 139
I20260620 23:03:44.796344 32000 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.796552 32000 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 139 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:44.796782 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 139 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.796782 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 139 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.797127 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 139 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:44.797262 32000 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Leader election lost for term 139. Reason: could not achieve majority
I20260620 23:03:44.802467 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 138. Current term is 139. Ops: []
I20260620 23:03:44.802768 32004 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 138.118, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260620 23:03:44.802899 32004 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 LEADER]: Stepping down as leader of term 138
I20260620 23:03:44.802971 32004 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:44.803041 32004 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 138.118, Last appended by leader: 118, Current term: 138, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.803145 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 138 FOLLOWER]: Advancing to term 139
I20260620 23:03:44.899607 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 138 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:44.899711 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 138 FOLLOWER]: Advancing to term 139
I20260620 23:03:44.900496 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.900697 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 139 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:44.900964 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 139 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:44.900967 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 139 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.901118 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 139: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:44.901635 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 139 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 139.
I20260620 23:03:44.901837 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 139 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:44.901944 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 FOLLOWER]: Leader election won for term 139
I20260620 23:03:44.902020 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.902076 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 138.118, Last appended by leader: 118, Current term: 139, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.902567 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 138 to 139, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 139 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:44.923853 32000 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:44.923952 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 139 FOLLOWER]: Advancing to term 140
I20260620 23:03:44.924759 32000 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.924948 32000 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 140 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:44.925184 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 140 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:44.925213 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 140 candidate_status { last_received { term: 138 index: 118 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:44.925331 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 139 FOLLOWER]: Advancing to term 140
I20260620 23:03:44.925931 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 140 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 140.
I20260620 23:03:44.926147 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 140 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:44.926244 32000 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 FOLLOWER]: Leader election won for term 140
I20260620 23:03:44.926357 32000 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:44.926401 32000 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 138.118, Last appended by leader: 118, Current term: 140, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.926852 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 139 to 140, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 140 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:44.978320 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 140 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 139. Current term is 140. Ops: []
I20260620 23:03:44.978644 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260620 23:03:44.978806 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 LEADER]: Stepping down as leader of term 139
I20260620 23:03:44.978835 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:44.978892 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 118, Committed index: 118, Last appended: 139.119, Last appended by leader: 119, Current term: 139, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:44.978973 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 139 FOLLOWER]: Advancing to term 140
I20260620 23:03:45.019625 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 140 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 138 index: 118. Preceding OpId from leader: term: 140 index: 119. (index mismatch)
I20260620 23:03:45.019954 32000 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260620 23:03:45.021042 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 140 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 139 index: 119. Preceding OpId from leader: term: 140 index: 119. (term mismatch)
I20260620 23:03:45.021095 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 118
I20260620 23:03:45.021118 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 139.119
I20260620 23:03:45.021138 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 140 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:45.021329 32000 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 119, Last known committed idx: 118, Time since last communication: 0.000s
I20260620 23:03:45.309826 32004 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 140 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:45.309947 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 140 FOLLOWER]: Advancing to term 141
I20260620 23:03:45.311542 32004 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.311793 32004 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 141 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:45.311964 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:45.311964 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:45.312302 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 141 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:45.312412 32004 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Leader election lost for term 141. Reason: could not achieve majority
I20260620 23:03:45.330852 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 140. Current term is 141. Ops: []
I20260620 23:03:45.331296 32000 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 140.119, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260620 23:03:45.331470 32000 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 LEADER]: Stepping down as leader of term 140
I20260620 23:03:45.331521 32000 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:45.331604 32000 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 140, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.331692 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 140 FOLLOWER]: Advancing to term 141
I20260620 23:03:45.375232 32001 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 140 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:45.375348 32001 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 140 FOLLOWER]: Advancing to term 141
I20260620 23:03:45.376251 32001 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.376452 32001 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 141 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:45.376703 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:45.376816 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 141: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:45.376719 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 141 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:45.377403 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 141 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 141.
I20260620 23:03:45.377612 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 141 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:45.377720 32001 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 FOLLOWER]: Leader election won for term 141
I20260620 23:03:45.377810 32001 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:45.377864 32001 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 141, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.378368 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 140 to 141, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 141 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:45.414999 32004 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:45.415118 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 141 FOLLOWER]: Advancing to term 142
I20260620 23:03:45.415839 32004 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.416028 32004 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 142 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:45.416296 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 142 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:45.416296 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 142 candidate_status { last_received { term: 140 index: 119 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:45.416510 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 141 FOLLOWER]: Advancing to term 142
I20260620 23:03:45.417102 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 142 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 142.
I20260620 23:03:45.417311 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 142 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:45.417435 32004 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 FOLLOWER]: Leader election won for term 142
I20260620 23:03:45.417575 32004 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:45.417621 32004 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 140.119, Last appended by leader: 119, Current term: 142, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.418105 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 141 to 142, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 142 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:45.476233 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 142 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 141. Current term is 142. Ops: []
I20260620 23:03:45.476560 32001 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260620 23:03:45.476719 32001 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 LEADER]: Stepping down as leader of term 141
I20260620 23:03:45.476785 32001 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:45.476853 32001 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 119, Committed index: 119, Last appended: 141.120, Last appended by leader: 120, Current term: 141, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.476956 32001 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 141 FOLLOWER]: Advancing to term 142
I20260620 23:03:45.516960 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 142 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 141 index: 120. Preceding OpId from leader: term: 142 index: 120. (term mismatch)
I20260620 23:03:45.517042 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 119
I20260620 23:03:45.517057 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 141.120
I20260620 23:03:45.517073 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 142 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:45.517331 32004 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260620 23:03:45.518530 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 142 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 140 index: 119. Preceding OpId from leader: term: 142 index: 120. (index mismatch)
I20260620 23:03:45.518803 32008 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 120, Last known committed idx: 119, Time since last communication: 0.000s
I20260620 23:03:45.619856 32000 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 142 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:45.619987 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 142 FOLLOWER]: Advancing to term 143
I20260620 23:03:45.620766 32000 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.620973 32000 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 143 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:45.621204 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:45.621227 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:45.621495 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 143 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:45.621598 32000 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Leader election lost for term 143. Reason: could not achieve majority
I20260620 23:03:45.640233 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 142. Current term is 143. Ops: []
I20260620 23:03:45.640532 32004 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 142.120, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260620 23:03:45.640683 32004 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 LEADER]: Stepping down as leader of term 142
I20260620 23:03:45.640717 32004 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:45.640769 32004 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 142, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.640862 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 142 FOLLOWER]: Advancing to term 143
I20260620 23:03:45.703001 32001 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 142 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:45.703117 32001 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 142 FOLLOWER]: Advancing to term 143
I20260620 23:03:45.703812 32001 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.704046 32001 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 143 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:45.704247 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:45.704412 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 143 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:45.704510 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 143: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:45.704998 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 143 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 143.
I20260620 23:03:45.705214 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 143 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:45.705315 32001 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 FOLLOWER]: Leader election won for term 143
I20260620 23:03:45.705367 32001 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:45.705436 32001 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 143, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.705930 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 142 to 143, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 143 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:45.747213 32000 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:45.747332 32000 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 143 FOLLOWER]: Advancing to term 144
I20260620 23:03:45.748219 32000 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.748440 32000 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 144 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:45.748685 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 144 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:45.748685 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 144 candidate_status { last_received { term: 142 index: 120 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:45.748855 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 143 FOLLOWER]: Advancing to term 144
I20260620 23:03:45.749476 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 144 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 144.
I20260620 23:03:45.749673 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 144 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:45.749794 32000 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 FOLLOWER]: Leader election won for term 144
I20260620 23:03:45.749881 32000 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:45.749950 32000 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 142.120, Last appended by leader: 120, Current term: 144, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.750437 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 143 to 144, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 144 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:45.762706 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:45.802639 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 144 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 143. Current term is 144. Ops: []
I20260620 23:03:45.802997 32001 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260620 23:03:45.803155 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 LEADER]: Stepping down as leader of term 143
I20260620 23:03:45.803203 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:45.803283 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 143.121, Last appended by leader: 121, Current term: 143, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:45.803366 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 143 FOLLOWER]: Advancing to term 144
I20260620 23:03:45.829016 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 144 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 142 index: 120. Preceding OpId from leader: term: 144 index: 121. (index mismatch)
I20260620 23:03:45.829509 32000 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260620 23:03:45.830950 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 144 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 143 index: 121. Preceding OpId from leader: term: 144 index: 121. (term mismatch)
I20260620 23:03:45.831013 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 120
I20260620 23:03:45.831036 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 143.121
I20260620 23:03:45.831070 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 144 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:45.831226 32009 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20260620 23:03:46.012247 32004 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 144 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:46.012351 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 144 FOLLOWER]: Advancing to term 145
I20260620 23:03:46.013054 32004 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.013240 32004 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 145 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.013480 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.013485 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:46.013770 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 145 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:46.013875 32004 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Leader election lost for term 145. Reason: could not achieve majority
I20260620 23:03:46.034385 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 144. Current term is 145. Ops: []
I20260620 23:03:46.034713 32009 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 144.121, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260620 23:03:46.034888 32006 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 LEADER]: Stepping down as leader of term 144
I20260620 23:03:46.034938 32006 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:46.034989 32006 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 144, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.035064 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 144 FOLLOWER]: Advancing to term 145
I20260620 23:03:46.106490 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 144 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:46.106599 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 144 FOLLOWER]: Advancing to term 145
I20260620 23:03:46.107277 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.107470 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 145 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.107707 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:46.107707 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 145 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.107829 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d232fa55064325956dcedc1e93af00 in current term 145: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:46.108501 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 145 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 145.
I20260620 23:03:46.108749 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 145 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 
I20260620 23:03:46.108886 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 FOLLOWER]: Leader election won for term 145
I20260620 23:03:46.108985 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:46.109045 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 145, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.109505 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 144 to 145, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 145 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:46.157114 32004 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:46.157212 32004 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 145 FOLLOWER]: Advancing to term 146
I20260620 23:03:46.157866 32004 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.158056 32004 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 146 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.158277 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 146 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.158341 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 145 FOLLOWER]: Advancing to term 146
I20260620 23:03:46.158281 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 146 candidate_status { last_received { term: 144 index: 121 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:46.159024 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 146 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 146.
I20260620 23:03:46.159219 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 146 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:46.159329 32004 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 FOLLOWER]: Leader election won for term 146
I20260620 23:03:46.159451 32004 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:46.159519 32004 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 144.121, Last appended by leader: 121, Current term: 146, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.159996 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 145 to 146, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 146 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:46.202338 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 145. Current term is 146. Ops: []
I20260620 23:03:46.202702 31996 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260620 23:03:46.202823 31996 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 146.122 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 121
I20260620 23:03:46.202847 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 LEADER]: Stepping down as leader of term 145
I20260620 23:03:46.202862 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:46.202947 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 121, Committed index: 121, Last appended: 145.122, Last appended by leader: 122, Current term: 145, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.203020 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 145 FOLLOWER]: Advancing to term 146
I20260620 23:03:46.244867 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 146 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 144 index: 121. Preceding OpId from leader: term: 146 index: 122. (index mismatch)
I20260620 23:03:46.245178 32004 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260620 23:03:46.246330 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 146 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 145 index: 122. Preceding OpId from leader: term: 146 index: 122. (term mismatch)
I20260620 23:03:46.246393 31727 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting all ops after (but not including) 121
I20260620 23:03:46.246413 31727 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: Aborting uncommitted NO_OP operation due to leader change: 145.122
I20260620 23:03:46.246439 31727 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 146 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:46.246640 32004 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 122, Last known committed idx: 121, Time since last communication: 0.000s
I20260620 23:03:46.554876 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 146 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:46.554983 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 146 FOLLOWER]: Advancing to term 147
I20260620 23:03:46.555804 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.556002 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 147 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.556285 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:46.556315 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.556591 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 147 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:46.556685 31996 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Leader election lost for term 147. Reason: could not achieve majority
I20260620 23:03:46.559783 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 146. Current term is 147. Ops: []
I20260620 23:03:46.560002 32011 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 146.122, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260620 23:03:46.560191 32011 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 LEADER]: Stepping down as leader of term 146
I20260620 23:03:46.560237 32011 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:46.560302 32011 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 146.122, Last appended by leader: 122, Current term: 146, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.560388 32011 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 146 FOLLOWER]: Advancing to term 147
I20260620 23:03:46.626896 32006 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 146 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:46.627027 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 146 FOLLOWER]: Advancing to term 147
I20260620 23:03:46.627753 32006 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.627980 32006 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 147 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:46.628211 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:46.628237 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 147 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:46.628324 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 147: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:46.628933 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 147 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 147.
I20260620 23:03:46.629112 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 147 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:46.629245 32006 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 FOLLOWER]: Leader election won for term 147
I20260620 23:03:46.629369 32006 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:46.629456 32006 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 146.122, Last appended by leader: 122, Current term: 147, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.629922 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 146 to 147, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 147 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:46.672657 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:46.672776 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 147 FOLLOWER]: Advancing to term 148
I20260620 23:03:46.673488 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.673682 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 148 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.673931 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 148 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.673931 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 148 candidate_status { last_received { term: 146 index: 122 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:46.674057 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 147 FOLLOWER]: Advancing to term 148
I20260620 23:03:46.674644 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 148 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 148.
I20260620 23:03:46.674863 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 148 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:46.674954 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 FOLLOWER]: Leader election won for term 148
I20260620 23:03:46.675007 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:46.675063 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 146.122, Last appended by leader: 122, Current term: 148, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.675565 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 147 to 148, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 148 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:46.710672 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 LEADER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 147. Current term is 148. Ops: []
I20260620 23:03:46.711007 32006 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260620 23:03:46.711148 32006 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer c8d232fa55064325956dcedc1e93af00 log is divergent from this leader: its last log entry 148.123 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 122
I20260620 23:03:46.711194 32012 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 LEADER]: Stepping down as leader of term 147
I20260620 23:03:46.711234 32012 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:46.711335 32012 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 122, Committed index: 122, Last appended: 147.123, Last appended by leader: 123, Current term: 147, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.711429 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 147 FOLLOWER]: Advancing to term 148
I20260620 23:03:46.752812 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 148 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 147 index: 123. Preceding OpId from leader: term: 148 index: 123. (term mismatch)
I20260620 23:03:46.752894 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 122
I20260620 23:03:46.752910 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 147.123
I20260620 23:03:46.752928 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 148 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:46.753212 31996 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260620 23:03:46.754366 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 148 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 146 index: 122. Preceding OpId from leader: term: 148 index: 123. (index mismatch)
I20260620 23:03:46.754577 32001 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 123, Last known committed idx: 122, Time since last communication: 0.000s
I20260620 23:03:46.762957 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:46.940850 32011 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 148 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:46.940968 32011 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 148 FOLLOWER]: Advancing to term 149
I20260620 23:03:46.941680 32011 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.941895 32011 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 149 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:46.942113 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 149 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:46.942113 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 149 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:46.942353 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 149 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:46.942502 32011 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Leader election lost for term 149. Reason: could not achieve majority
I20260620 23:03:46.942574 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 148. Current term is 149. Ops: []
I20260620 23:03:46.942785 32013 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 148.123, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260620 23:03:46.942899 31996 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 LEADER]: Stepping down as leader of term 148
I20260620 23:03:46.942938 31996 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:46.943013 31996 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 148.123, Last appended by leader: 123, Current term: 148, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.943096 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 148 FOLLOWER]: Advancing to term 149
I20260620 23:03:46.976841 32012 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 148 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:46.976944 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 148 FOLLOWER]: Advancing to term 149
I20260620 23:03:46.977618 32012 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.977823 32012 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 149 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:46.978062 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 149 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:46.978072 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 149 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:46.978220 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 149: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:46.978811 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 149 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 149.
I20260620 23:03:46.979007 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 149 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:46.979111 32012 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 FOLLOWER]: Leader election won for term 149
I20260620 23:03:46.979188 32012 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:46.979255 32012 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 148.123, Last appended by leader: 123, Current term: 149, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:46.979771 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 148 to 149, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 149 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:47.060772 32011 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:47.060882 32011 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 149 FOLLOWER]: Advancing to term 150
I20260620 23:03:47.061640 32011 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.061861 32011 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 150 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:47.062081 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 150 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:47.062103 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 150 candidate_status { last_received { term: 148 index: 123 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:47.062196 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 149 FOLLOWER]: Advancing to term 150
I20260620 23:03:47.062831 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 150 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 150.
I20260620 23:03:47.063033 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 150 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:47.063165 32011 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 FOLLOWER]: Leader election won for term 150
I20260620 23:03:47.063328 32011 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:47.063393 32011 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 148.123, Last appended by leader: 123, Current term: 150, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.063956 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 149 to 150, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 150 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:47.075067 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 LEADER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 149. Current term is 150. Ops: []
I20260620 23:03:47.075451 32012 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260620 23:03:47.075580 32012 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 150.124 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 123
I20260620 23:03:47.075613 32006 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 LEADER]: Stepping down as leader of term 149
I20260620 23:03:47.075647 32006 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:47.075730 32006 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 123, Committed index: 123, Last appended: 149.124, Last appended by leader: 124, Current term: 149, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.075824 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 149 FOLLOWER]: Advancing to term 150
I20260620 23:03:47.169868 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 150 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 148 index: 123. Preceding OpId from leader: term: 150 index: 124. (index mismatch)
I20260620 23:03:47.170312 32011 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260620 23:03:47.171666 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 150 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 149 index: 124. Preceding OpId from leader: term: 150 index: 124. (term mismatch)
I20260620 23:03:47.171733 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 123
I20260620 23:03:47.171753 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 149.124
I20260620 23:03:47.171774 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 150 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:47.171924 32014 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 124, Last known committed idx: 123, Time since last communication: 0.000s
I20260620 23:03:47.365832 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 150 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:47.365929 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 150 FOLLOWER]: Advancing to term 151
I20260620 23:03:47.366640 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.366838 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 151 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:47.367166 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 151 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:47.367205 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 151 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:47.367436 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 151 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:47.367550 31996 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Leader election lost for term 151. Reason: could not achieve majority
I20260620 23:03:47.383885 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 150. Current term is 151. Ops: []
I20260620 23:03:47.384289 32015 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 150.124, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260620 23:03:47.384456 32015 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 LEADER]: Stepping down as leader of term 150
I20260620 23:03:47.384480 32015 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:47.384614 32015 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 150.124, Last appended by leader: 124, Current term: 150, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.384740 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 150 FOLLOWER]: Advancing to term 151
I20260620 23:03:47.462075 32006 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 150 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:47.462186 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 150 FOLLOWER]: Advancing to term 151
I20260620 23:03:47.462951 32006 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.463145 32006 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 151 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:47.463398 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 151 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:47.463398 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 151 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:47.463528 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 151: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:47.464143 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 151 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 151.
I20260620 23:03:47.464357 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 151 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:47.464437 32006 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 FOLLOWER]: Leader election won for term 151
I20260620 23:03:47.464506 32006 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:47.464564 32006 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 150.124, Last appended by leader: 124, Current term: 151, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.465058 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 150 to 151, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 151 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:47.488708 31996 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:47.488813 31996 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 151 FOLLOWER]: Advancing to term 152
I20260620 23:03:47.489475 31996 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.489653 31996 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 152 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:47.489894 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 152 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:47.489965 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 151 FOLLOWER]: Advancing to term 152
I20260620 23:03:47.489905 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 152 candidate_status { last_received { term: 150 index: 124 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:47.490532 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 152 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 152.
I20260620 23:03:47.490736 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 152 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:47.490862 31996 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 FOLLOWER]: Leader election won for term 152
I20260620 23:03:47.490993 31996 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:47.491052 31996 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 150.124, Last appended by leader: 124, Current term: 152, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.491540 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 151 to 152, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 152 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:47.541514 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 152 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 151. Current term is 152. Ops: []
I20260620 23:03:47.541783 32006 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260620 23:03:47.541939 32006 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 LEADER]: Stepping down as leader of term 151
I20260620 23:03:47.541975 32006 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:47.542034 32006 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 124, Committed index: 124, Last appended: 151.125, Last appended by leader: 125, Current term: 151, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.542127 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 151 FOLLOWER]: Advancing to term 152
I20260620 23:03:47.585317 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 152 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 150 index: 124. Preceding OpId from leader: term: 152 index: 125. (index mismatch)
I20260620 23:03:47.585613 31996 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260620 23:03:47.586624 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 152 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 151 index: 125. Preceding OpId from leader: term: 152 index: 125. (term mismatch)
I20260620 23:03:47.586692 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 124
I20260620 23:03:47.586716 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 151.125
I20260620 23:03:47.586750 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 152 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:47.587005 32017 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 125, Last known committed idx: 124, Time since last communication: 0.000s
I20260620 23:03:47.687841 32015 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 152 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:47.687943 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 152 FOLLOWER]: Advancing to term 153
I20260620 23:03:47.688906 32015 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.689052 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 152. Current term is 153. Ops: []
I20260620 23:03:47.689097 32015 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 153 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:47.689288 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 153 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:47.689327 32016 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 152.125, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260620 23:03:47.689296 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 153 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:47.689567 32016 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 LEADER]: Stepping down as leader of term 152
I20260620 23:03:47.689607 32016 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:47.689661 32016 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 152.125, Last appended by leader: 125, Current term: 152, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.689761 32016 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 152 FOLLOWER]: Advancing to term 153
I20260620 23:03:47.690411 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 153 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece; no voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:47.690541 32015 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Leader election lost for term 153. Reason: could not achieve majority
I20260620 23:03:47.763257 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:47.777321 32006 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 152 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:47.777426 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 152 FOLLOWER]: Advancing to term 153
I20260620 23:03:47.778156 32006 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.778380 32006 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 153 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:47.778646 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 153 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:47.778650 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 153 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:47.778784 31802 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 153: Already voted for candidate 2aae72e27c8349aa99eecc09eceeaece in this term.
I20260620 23:03:47.779417 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 153 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 153.
I20260620 23:03:47.779597 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 153 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:47.779696 32006 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 FOLLOWER]: Leader election won for term 153
I20260620 23:03:47.779752 32006 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:47.779817 32006 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 152.125, Last appended by leader: 125, Current term: 153, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.780319 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 152 to 153, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 153 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:47.823405 32015 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:47.823503 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 153 FOLLOWER]: Advancing to term 154
I20260620 23:03:47.824340 32015 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.824534 32015 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 154 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:47.824790 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 154 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:47.824853 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 154 candidate_status { last_received { term: 152 index: 125 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:47.824956 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 153 FOLLOWER]: Advancing to term 154
I20260620 23:03:47.825500 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 154 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 154.
I20260620 23:03:47.825687 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 154 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:47.825793 32015 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 FOLLOWER]: Leader election won for term 154
I20260620 23:03:47.825841 32015 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:47.825893 32015 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 152.125, Last appended by leader: 125, Current term: 154, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.826375 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 153 to 154, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 154 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:47.875406 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 154 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 153. Current term is 154. Ops: []
I20260620 23:03:47.875749 32006 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260620 23:03:47.875900 32006 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 LEADER]: Stepping down as leader of term 153
I20260620 23:03:47.875926 32006 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:47.875985 32006 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 125, Committed index: 125, Last appended: 153.126, Last appended by leader: 126, Current term: 153, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:47.876092 32006 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 153 FOLLOWER]: Advancing to term 154
I20260620 23:03:47.924265 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 154 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 152 index: 125. Preceding OpId from leader: term: 154 index: 126. (index mismatch)
I20260620 23:03:47.924680 32015 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260620 23:03:47.926045 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 154 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 153 index: 126. Preceding OpId from leader: term: 154 index: 126. (term mismatch)
I20260620 23:03:47.926110 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 125
I20260620 23:03:47.926132 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 153.126
I20260620 23:03:47.926162 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 154 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:47.926333 32018 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 126, Last known committed idx: 125, Time since last communication: 0.000s
I20260620 23:03:48.192938 32016 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 154 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:48.193094 32016 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 154 FOLLOWER]: Advancing to term 155
I20260620 23:03:48.193907 32016 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.194175 32016 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 155 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:48.194394 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 155 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:48.194388 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 155 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:48.194700 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 155 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:48.194830 32016 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Leader election lost for term 155. Reason: could not achieve majority
I20260620 23:03:48.213366 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 154. Current term is 155. Ops: []
I20260620 23:03:48.213681 32011 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 154.126, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260620 23:03:48.213881 32015 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 LEADER]: Stepping down as leader of term 154
I20260620 23:03:48.213934 32015 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:48.214031 32015 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 154.126, Last appended by leader: 126, Current term: 154, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.214129 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 154 FOLLOWER]: Advancing to term 155
I20260620 23:03:48.290391 32012 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 154 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:48.290494 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 154 FOLLOWER]: Advancing to term 155
I20260620 23:03:48.291191 32012 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.291419 32012 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 155 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:48.291653 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 155 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:48.291667 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 155 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:48.292111 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 155: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:48.292506 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 155 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 155.
I20260620 23:03:48.292740 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 155 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:48.292836 32012 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 FOLLOWER]: Leader election won for term 155
I20260620 23:03:48.292888 32012 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:48.292938 32012 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 154.126, Last appended by leader: 126, Current term: 155, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.293394 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 154 to 155, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 155 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:48.334609 32016 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:48.334712 32016 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 155 FOLLOWER]: Advancing to term 156
I20260620 23:03:48.335459 32016 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.335673 32016 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 156 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:48.335938 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 156 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:48.335943 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 156 candidate_status { last_received { term: 154 index: 126 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:48.336102 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 155 FOLLOWER]: Advancing to term 156
I20260620 23:03:48.336706 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 156 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 156.
I20260620 23:03:48.336892 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 156 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:48.337023 32016 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 FOLLOWER]: Leader election won for term 156
I20260620 23:03:48.337183 32016 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:48.337287 32016 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 154.126, Last appended by leader: 126, Current term: 156, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.337792 31547 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 155 to 156, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 156 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:48.387200 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 156 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 155. Current term is 156. Ops: []
I20260620 23:03:48.387494 32012 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260620 23:03:48.387635 32012 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 LEADER]: Stepping down as leader of term 155
I20260620 23:03:48.387676 32012 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:48.387753 32012 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 126, Committed index: 126, Last appended: 155.127, Last appended by leader: 127, Current term: 155, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.387830 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 155 FOLLOWER]: Advancing to term 156
I20260620 23:03:48.446540 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 156 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 155 index: 127. Preceding OpId from leader: term: 156 index: 127. (term mismatch)
I20260620 23:03:48.446648 31652 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting all ops after (but not including) 126
I20260620 23:03:48.446674 31652 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: Aborting uncommitted NO_OP operation due to leader change: 155.127
I20260620 23:03:48.446735 31652 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 156 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:48.447059 32016 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260620 23:03:48.448278 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 156 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 154 index: 126. Preceding OpId from leader: term: 156 index: 127. (index mismatch)
I20260620 23:03:48.448453 32019 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 127, Last known committed idx: 126, Time since last communication: 0.000s
I20260620 23:03:48.735891 32012 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 156 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:48.735989 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 156 FOLLOWER]: Advancing to term 157
I20260620 23:03:48.737044 32012 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.737217 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 156. Current term is 157. Ops: []
I20260620 23:03:48.737313 32012 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 157 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:48.737524 32020 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 156.127, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260620 23:03:48.737505 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 157 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:48.737512 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 157 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:48.737802 32016 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 LEADER]: Stepping down as leader of term 156
I20260620 23:03:48.737810 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 157 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:48.737851 32016 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:48.737914 32012 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Leader election lost for term 157. Reason: could not achieve majority
I20260620 23:03:48.737993 32016 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 156.127, Last appended by leader: 127, Current term: 156, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.738124 32016 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 156 FOLLOWER]: Advancing to term 157
I20260620 23:03:48.763530 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:48.830325 32015 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 156 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:48.830425 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 156 FOLLOWER]: Advancing to term 157
I20260620 23:03:48.831121 32015 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.831388 32015 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 157 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:48.831570 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 157 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:48.831670 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 157 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:48.831799 31652 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 157: Already voted for candidate e958ff05bd794a0496045351b3a629d9 in this term.
I20260620 23:03:48.832257 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 157 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 157.
I20260620 23:03:48.832464 31766 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 157 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:48.832613 32015 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 FOLLOWER]: Leader election won for term 157
I20260620 23:03:48.832746 32015 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:48.832808 32015 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 156.127, Last appended by leader: 127, Current term: 157, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.833264 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 156 to 157, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 157 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:48.843556 32012 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:48.843689 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 157 FOLLOWER]: Advancing to term 158
I20260620 23:03:48.844754 32012 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.844940 32012 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 158 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:48.845124 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 158 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:48.845212 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 158 candidate_status { last_received { term: 156 index: 127 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:48.845342 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 157 FOLLOWER]: Advancing to term 158
I20260620 23:03:48.846169 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 158 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 158.
I20260620 23:03:48.846418 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 158 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:48.846536 32012 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 FOLLOWER]: Leader election won for term 158
I20260620 23:03:48.846608 32012 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:48.846668 32012 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 156.127, Last appended by leader: 127, Current term: 158, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.847209 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 157 to 158, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 158 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:48.948668 31802 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 LEADER]: Stepping down as leader of term 157
I20260620 23:03:48.948750 31802 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:48.948805 31802 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 127, Committed index: 127, Last appended: 157.128, Last appended by leader: 128, Current term: 157, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:48.948943 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 157 FOLLOWER]: Advancing to term 158
I20260620 23:03:48.949652 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 158 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 157 index: 128. Preceding OpId from leader: term: 158 index: 128. (term mismatch)
I20260620 23:03:48.949690 31802 pending_rounds.cc:76] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting all ops after (but not including) 127
I20260620 23:03:48.949703 31802 pending_rounds.cc:97] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting uncommitted NO_OP operation due to leader change: 157.128
I20260620 23:03:48.949744 31802 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 158 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:48.949997 32012 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260620 23:03:48.951193 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 158 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 156 index: 127. Preceding OpId from leader: term: 158 index: 128. (index mismatch)
I20260620 23:03:48.951509 32012 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 128, Last known committed idx: 127, Time since last communication: 0.000s
I20260620 23:03:49.052933 32020 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 158 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:49.053037 32020 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 158 FOLLOWER]: Advancing to term 159
I20260620 23:03:49.053807 32020 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.053993 32020 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 159 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.054219 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 159 candidate_status { last_received { term: 158 index: 128 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:49.054339 31802 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 158 FOLLOWER]: Advancing to term 159
I20260620 23:03:49.054255 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 159 candidate_status { last_received { term: 158 index: 128 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:49.054949 31802 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 159 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8d232fa55064325956dcedc1e93af00 in term 159.
I20260620 23:03:49.055161 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 159 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00; no voters: e958ff05bd794a0496045351b3a629d9
I20260620 23:03:49.055275 32020 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 FOLLOWER]: Leader election won for term 159
I20260620 23:03:49.055335 32020 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 LEADER]: Becoming Leader. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:49.055393 32020 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 158.128, Last appended by leader: 128, Current term: 159, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.055896 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 reported cstate change: term changed from 158 to 159, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to c8d232fa55064325956dcedc1e93af00 (127.30.199.130). New cstate: current_term: 159 leader_uuid: "c8d232fa55064325956dcedc1e93af00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:49.068401 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 159 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 158. Current term is 159. Ops: []
I20260620 23:03:49.068764 32012 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 158.128, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260620 23:03:49.068904 32012 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 LEADER]: Stepping down as leader of term 158
I20260620 23:03:49.068944 32012 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:49.069010 32012 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 128, Committed index: 128, Last appended: 158.128, Last appended by leader: 128, Current term: 158, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.069137 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 158 FOLLOWER]: Advancing to term 159
I20260620 23:03:49.144610 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 159 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 158 index: 128. Preceding OpId from leader: term: 159 index: 129. (index mismatch)
I20260620 23:03:49.144932 32020 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260620 23:03:49.146109 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 159 FOLLOWER]: Refusing update from remote peer c8d232fa55064325956dcedc1e93af00: Log matching property violated. Preceding OpId in replica: term: 158 index: 128. Preceding OpId from leader: term: 159 index: 129. (index mismatch)
I20260620 23:03:49.146306 32022 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 129, Last known committed idx: 128, Time since last communication: 0.000s
I20260620 23:03:49.247184 32015 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 159 FOLLOWER]: Starting leader election (detected failure of leader c8d232fa55064325956dcedc1e93af00)
I20260620 23:03:49.247313 32015 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 159 FOLLOWER]: Advancing to term 160
I20260620 23:03:49.248232 32015 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.248453 32015 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 160 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.248719 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 160 candidate_status { last_received { term: 159 index: 129 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:49.248719 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 160 candidate_status { last_received { term: 159 index: 129 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:49.248826 31652 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 159 FOLLOWER]: Advancing to term 160
I20260620 23:03:49.249406 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 160 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 160.
I20260620 23:03:49.249614 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 160 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:49.249737 32015 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 FOLLOWER]: Leader election won for term 160
I20260620 23:03:49.249791 32015 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:49.249847 32015 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 159.129, Last appended by leader: 129, Current term: 160, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.250339 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 159 to 160, leader changed from c8d232fa55064325956dcedc1e93af00 (127.30.199.130) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 160 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:49.268735 31652 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 160 FOLLOWER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 159. Current term is 160. Ops: []
I20260620 23:03:49.268828 31802 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 LEADER]: Rejecting Update request from peer c8d232fa55064325956dcedc1e93af00 for earlier term 159. Current term is 160. Ops: []
I20260620 23:03:49.269050 32020 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: INVALID_TERM, Last received: 159.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260620 23:03:49.269210 32016 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 LEADER]: Stepping down as leader of term 159
I20260620 23:03:49.269260 32016 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 LEADER]: Becoming Follower/Learner. State: Replica: c8d232fa55064325956dcedc1e93af00, State: Running, Role: LEADER
I20260620 23:03:49.269224 32022 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: INVALID_TERM, Last received: 159.129, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260620 23:03:49.269361 32022 consensus_queue.cc:1225] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [LEADER]: Peer 2aae72e27c8349aa99eecc09eceeaece log is divergent from this leader: its last log entry 160.130 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 129
I20260620 23:03:49.269410 32016 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 129, Committed index: 129, Last appended: 159.129, Last appended by leader: 129, Current term: 159, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.269543 32016 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 159 FOLLOWER]: Advancing to term 160
I20260620 23:03:49.366251 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 160 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 159 index: 129. Preceding OpId from leader: term: 160 index: 130. (index mismatch)
I20260620 23:03:49.366595 32015 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260620 23:03:49.367197 31652 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 160 FOLLOWER]: Refusing update from remote peer 2aae72e27c8349aa99eecc09eceeaece: Log matching property violated. Preceding OpId in replica: term: 159 index: 129. Preceding OpId from leader: term: 160 index: 130. (index mismatch)
I20260620 23:03:49.367424 32015 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Connected to new peer: Peer: permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 130, Last known committed idx: 129, Time since last communication: 0.000s
I20260620 23:03:49.469002 32012 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 160 FOLLOWER]: Starting leader election (detected failure of leader 2aae72e27c8349aa99eecc09eceeaece)
I20260620 23:03:49.469113 32012 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 160 FOLLOWER]: Advancing to term 161
I20260620 23:03:49.469944 32012 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.470149 32012 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 161 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:49.470436 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 161 candidate_status { last_received { term: 160 index: 130 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:49.470508 31727 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 160 FOLLOWER]: Advancing to term 161
I20260620 23:03:49.470445 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 161 candidate_status { last_received { term: 160 index: 130 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:49.471097 31727 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 161 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e958ff05bd794a0496045351b3a629d9 in term 161.
I20260620 23:03:49.471328 31615 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 161 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c8d232fa55064325956dcedc1e93af00, e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece
I20260620 23:03:49.471441 32012 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 FOLLOWER]: Leader election won for term 161
I20260620 23:03:49.471525 32012 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 LEADER]: Becoming Leader. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:49.471597 32012 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 160.130, Last appended by leader: 130, Current term: 161, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.472174 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 reported cstate change: term changed from 160 to 161, leader changed from 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131) to e958ff05bd794a0496045351b3a629d9 (127.30.199.129). New cstate: current_term: 161 leader_uuid: "e958ff05bd794a0496045351b3a629d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:49.477177 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 161 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 160. Current term is 161. Ops: []
I20260620 23:03:49.477492 32015 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 160.130, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260620 23:03:49.477684 32023 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 LEADER]: Stepping down as leader of term 160
I20260620 23:03:49.477723 32023 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:49.477794 32023 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 130, Committed index: 130, Last appended: 160.130, Last appended by leader: 130, Current term: 160, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.477883 32023 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 160 FOLLOWER]: Advancing to term 161
I20260620 23:03:49.574891 31802 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 161 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 160 index: 130. Preceding OpId from leader: term: 161 index: 131. (index mismatch)
I20260620 23:03:49.575330 32012 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260620 23:03:49.576509 31727 raft_consensus.cc:1261] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 161 FOLLOWER]: Refusing update from remote peer e958ff05bd794a0496045351b3a629d9: Log matching property violated. Preceding OpId in replica: term: 160 index: 130. Preceding OpId from leader: term: 161 index: 131. (index mismatch)
I20260620 23:03:49.576717 32012 consensus_queue.cc:1035] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 131, Last known committed idx: 130, Time since last communication: 0.000s
I20260620 23:03:49.678061 32022 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 161 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:49.678205 32022 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 161 FOLLOWER]: Advancing to term 162
I20260620 23:03:49.679000 32022 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.679320 32022 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 162 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.679486 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 162 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:49.679524 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 162 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:49.679806 31692 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 162 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:49.679930 32022 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Leader election lost for term 162. Reason: could not achieve majority
I20260620 23:03:49.683106 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Rejecting Update request from peer e958ff05bd794a0496045351b3a629d9 for earlier term 161. Current term is 162. Ops: []
I20260620 23:03:49.683372 32024 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 161.131, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260620 23:03:49.683557 32024 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 LEADER]: Stepping down as leader of term 161
I20260620 23:03:49.683598 32024 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 LEADER]: Becoming Follower/Learner. State: Replica: e958ff05bd794a0496045351b3a629d9, State: Running, Role: LEADER
I20260620 23:03:49.683671 32024 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 161.131, Last appended by leader: 131, Current term: 161, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.683791 32024 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 161 FOLLOWER]: Advancing to term 162
I20260620 23:03:49.759967 32023 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 161 FOLLOWER]: Starting leader election (detected failure of leader e958ff05bd794a0496045351b3a629d9)
I20260620 23:03:49.760105 32023 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 161 FOLLOWER]: Advancing to term 162
I20260620 23:03:49.760814 32023 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.761039 32023 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 162 election: Requested vote from peers c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.761297 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 162 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:49.761297 31652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "2aae72e27c8349aa99eecc09eceeaece" candidate_term: 162 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "e958ff05bd794a0496045351b3a629d9"
I20260620 23:03:49.761435 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Leader election vote request: Denying vote to candidate 2aae72e27c8349aa99eecc09eceeaece in current term 162: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:49.762037 31652 raft_consensus.cc:2454] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 162 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2aae72e27c8349aa99eecc09eceeaece in term 162.
I20260620 23:03:49.762221 31768 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [CANDIDATE]: Term 162 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9; no voters: c8d232fa55064325956dcedc1e93af00
I20260620 23:03:49.762333 32023 raft_consensus.cc:2781] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 FOLLOWER]: Leader election won for term 162
I20260620 23:03:49.762392 32023 raft_consensus.cc:686] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 LEADER]: Becoming Leader. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:49.762454 32023 consensus_queue.cc:237] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 161.131, Last appended by leader: 131, Current term: 162, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.762974 31546 catalog_manager.cc:5495] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece reported cstate change: term changed from 161 to 162, leader changed from e958ff05bd794a0496045351b3a629d9 (127.30.199.129) to 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131). New cstate: current_term: 162 leader_uuid: "2aae72e27c8349aa99eecc09eceeaece" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:49.763912 31518 timestamp_advancement-itest.cc:261] GCing logs...
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/timestamp_advancement-itest.cc:261: Failure
Expected: (gcable_size) > (0), actual: 0 vs 0
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:395: Failure
Failed
Timed out waiting for assertion to pass.
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/timestamp_advancement-itest.cc:326: Failure
Expected: GCUntilNoWritesInWAL(ts, replica) doesn't generate new fatal failures in the current thread.
  Actual: it does.
I20260620 23:03:49.764261 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:49.820842 32022 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:49.820943 32022 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.821753 32022 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.821964 32022 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367)
I20260620 23:03:49.822217 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "c8d232fa55064325956dcedc1e93af00" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
W20260620 23:03:49.822417 31691 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 23:03:49.822939 31691 leader_election.cc:334] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: RPC error from VoteRequest() call to peer e958ff05bd794a0496045351b3a629d9 (127.30.199.129:42367): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260620 23:03:49.823014 31691 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d232fa55064325956dcedc1e93af00; no voters: 2aae72e27c8349aa99eecc09eceeaece, e958ff05bd794a0496045351b3a629d9
I20260620 23:03:49.823143 32022 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260620 23:03:49.859777 31727 raft_consensus.cc:1226] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Rejecting Update request from peer 2aae72e27c8349aa99eecc09eceeaece for earlier term 162. Current term is 163. Ops: []
I20260620 23:03:49.860090 32023 consensus_queue.cc:1046] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 }, Status: INVALID_TERM, Last received: 0.0, Next index: 132, Last known committed idx: 131, Time since last communication: 0.000s
I20260620 23:03:49.860255 32023 raft_consensus.cc:3032] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 LEADER]: Stepping down as leader of term 162
I20260620 23:03:49.860320 32023 raft_consensus.cc:729] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 LEADER]: Becoming Follower/Learner. State: Replica: 2aae72e27c8349aa99eecc09eceeaece, State: Running, Role: LEADER
I20260620 23:03:49.860396 32023 consensus_queue.cc:260] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 131, Committed index: 131, Last appended: 162.132, Last appended by leader: 132, Current term: 162, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.860489 32023 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.911717 32024 raft_consensus.cc:482] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 162 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:49.911834 32024 raft_consensus.cc:3037] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 162 FOLLOWER]: Advancing to term 163
I20260620 23:03:49.912667 32024 raft_consensus.cc:504] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2aae72e27c8349aa99eecc09eceeaece" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 39569 } } peers { permanent_uuid: "c8d232fa55064325956dcedc1e93af00" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 36383 } } peers { permanent_uuid: "e958ff05bd794a0496045351b3a629d9" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42367 } }
I20260620 23:03:49.912863 32024 leader_election.cc:288] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 163 election: Requested vote from peers 2aae72e27c8349aa99eecc09eceeaece (127.30.199.131:39569), c8d232fa55064325956dcedc1e93af00 (127.30.199.130:36383)
I20260620 23:03:49.913131 31727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "c8d232fa55064325956dcedc1e93af00"
I20260620 23:03:49.913141 31802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5c6e030336e490c8b6a4c3ee3f98043" candidate_uuid: "e958ff05bd794a0496045351b3a629d9" candidate_term: 163 candidate_status { last_received { term: 161 index: 131 } } ignore_live_leader: false dest_uuid: "2aae72e27c8349aa99eecc09eceeaece"
I20260620 23:03:49.913302 31727 raft_consensus.cc:2379] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 in current term 163: Already voted for candidate c8d232fa55064325956dcedc1e93af00 in this term.
I20260620 23:03:49.913348 31802 raft_consensus.cc:2396] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Leader election vote request: Denying vote to candidate e958ff05bd794a0496045351b3a629d9 for term 163 because replica has last-logged OpId of term: 162 index: 132, which is greater than that of the candidate, which has last-logged OpId of term: 161 index: 131.
I20260620 23:03:49.913550 31618 leader_election.cc:302] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [CANDIDATE]: Term 163 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e958ff05bd794a0496045351b3a629d9; no voters: 2aae72e27c8349aa99eecc09eceeaece, c8d232fa55064325956dcedc1e93af00
I20260620 23:03:49.913669 32024 raft_consensus.cc:2726] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Leader election lost for term 163. Reason: could not achieve majority
I20260620 23:03:49.927671 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.927852 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9: stopping tablet replica
I20260620 23:03:49.927983 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.928049 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P e958ff05bd794a0496045351b3a629d9 [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:49.940958 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:49.942476 31518 tablet_server.cc:178] TabletServer@127.30.199.130:0 shutting down...
I20260620 23:03:49.978211 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.978439 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00: stopping tablet replica
I20260620 23:03:49.978504 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.978579 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P c8d232fa55064325956dcedc1e93af00 [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:49.990785 31518 tablet_server.cc:194] TabletServer@127.30.199.130:0 shutdown complete.
I20260620 23:03:49.991809 31518 tablet_server.cc:178] TabletServer@127.30.199.131:0 shutting down...
I20260620 23:03:49.996701 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:49.996820 31518 tablet_replica.cc:330] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: stopping tablet replica
I20260620 23:03:49.996882 31518 raft_consensus.cc:2229] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:49.996940 31518 pending_rounds.cc:62] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Trying to abort 1 pending ops.
I20260620 23:03:49.996953 31518 pending_rounds.cc:68] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece: Aborting op as it isn't in flight: id { term: 162 index: 132 } timestamp: 7299058195507621888 op_type: NO_OP noop_request { }
I20260620 23:03:49.997043 31518 raft_consensus.cc:2866] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 23:03:49.997068 31518 raft_consensus.cc:2258] T e5c6e030336e490c8b6a4c3ee3f98043 P 2aae72e27c8349aa99eecc09eceeaece [term 163 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:50.009236 31518 tablet_server.cc:194] TabletServer@127.30.199.131:0 shutdown complete.
I20260620 23:03:50.010416 31518 master.cc:537] Master@127.30.199.190:39689 shutting down...
I20260620 23:03:50.111253 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:50.111368 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:50.111397 31518 tablet_replica.cc:330] T 00000000000000000000000000000000 P fdb3340f5d3f42e589d7f0ed66f6d555: stopping tablet replica
I20260620 23:03:50.123991 31518 master.cc:552] Master@127.30.199.190:39689 shutdown complete.
I20260620 23:03:50.126276 31518 test_util.cc:175] -----------------------------------------------
I20260620 23:03:50.126379 31518 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1781996597556624-31518-0
[  FAILED  ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (32558 ms)
[ RUN      ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260620 23:03:50.126981 31518 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.199.190:40137
I20260620 23:03:50.127182 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 23:03:50.129052 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:50.129058 32029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.129148 32027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.129383 32026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:50.129521 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:50.129575 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:50.129594 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996630129594 us; error 0 us; skew 500 ppm
I20260620 23:03:50.130302 31518 webserver.cc:460] Webserver started at http://127.30.199.190:36637/ using document root <none> and password file <none>
I20260620 23:03:50.130407 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:50.130457 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:50.130505 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:50.130805 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/master-0-root/instance:
uuid: "39e1a3b4c63645b295e98183ad024fa9"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.131778 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:50.132344 32034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.132472 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.132524 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/master-0-root
uuid: "39e1a3b4c63645b295e98183ad024fa9"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.132567 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:50.153959 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:50.154160 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:50.157011 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.190:40137
I20260620 23:03:50.158758 32086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.190:40137 every 8 connection(s)
I20260620 23:03:50.158851 32087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:50.159843 32087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9: Bootstrap starting.
I20260620 23:03:50.160166 32087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:50.160683 32087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9: No bootstrap required, opened a new log
I20260620 23:03:50.160785 32087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER }
I20260620 23:03:50.160837 32087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:50.160851 32087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39e1a3b4c63645b295e98183ad024fa9, State: Initialized, Role: FOLLOWER
I20260620 23:03:50.160913 32087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER }
I20260620 23:03:50.160965 32087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:50.160981 32087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:50.160997 32087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:50.161449 32087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER }
I20260620 23:03:50.161504 32087 leader_election.cc:302] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39e1a3b4c63645b295e98183ad024fa9; no voters: 
I20260620 23:03:50.161628 32087 leader_election.cc:288] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 23:03:50.161649 32090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:50.161774 32090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 1 LEADER]: Becoming Leader. State: Replica: 39e1a3b4c63645b295e98183ad024fa9, State: Running, Role: LEADER
I20260620 23:03:50.161798 32087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 23:03:50.161900 32090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER }
I20260620 23:03:50.162155 32091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39e1a3b4c63645b295e98183ad024fa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER } }
I20260620 23:03:50.162328 32091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:50.162170 32092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39e1a3b4c63645b295e98183ad024fa9. Latest consensus state: current_term: 1 leader_uuid: "39e1a3b4c63645b295e98183ad024fa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39e1a3b4c63645b295e98183ad024fa9" member_type: VOTER } }
I20260620 23:03:50.162516 32092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:50.162618 32099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 23:03:50.162797 32099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 23:03:50.163209 31518 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 23:03:50.163362 32099 catalog_manager.cc:1347] Generated new cluster ID: 5d0f6bbec8bd49e5abf3605e7ef09883
I20260620 23:03:50.163403 32099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 23:03:50.178218 32099 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 23:03:50.178695 32099 catalog_manager.cc:1504] Loading token signing keys...
I20260620 23:03:50.184242 32099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9: Generated new TSK 0
I20260620 23:03:50.184335 32099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 23:03:50.195216 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:50.196812 32111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.196843 32108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.196935 32109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:50.197121 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:50.197234 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:50.197288 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:50.197319 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996630197319 us; error 0 us; skew 500 ppm
I20260620 23:03:50.198114 31518 webserver.cc:460] Webserver started at http://127.30.199.129:39223/ using document root <none> and password file <none>
I20260620 23:03:50.198223 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:50.198276 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:50.198328 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:50.198622 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root/instance:
uuid: "bee0ba2503744c44838b670cd7e0de39"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.199544 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.001s
I20260620 23:03:50.200022 32116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.200181 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.200238 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "bee0ba2503744c44838b670cd7e0de39"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.200309 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:50.214458 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:50.214721 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:50.214905 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:50.215152 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:50.215204 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.215245 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:50.215273 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.218250 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:42675
I20260620 23:03:50.218281 32179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:42675 every 8 connection(s)
I20260620 23:03:50.218652 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:50.220220 32185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.220255 32187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.220220 32184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:50.220700 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:50.220822 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:50.220854 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:50.220872 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996630220872 us; error 0 us; skew 500 ppm
I20260620 23:03:50.221526 31518 webserver.cc:460] Webserver started at http://127.30.199.130:46149/ using document root <none> and password file <none>
I20260620 23:03:50.221623 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:50.221668 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:50.221719 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:50.222038 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-1-root/instance:
uuid: "77b91cbc17364fb184ef155e79a431db"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.223433 32180 heartbeater.cc:347] Connected to a master server at 127.30.199.190:40137
I20260620 23:03:50.223451 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:50.223527 32180 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:50.223616 32180 heartbeater.cc:511] Master 127.30.199.190:40137 requested a full tablet report, sending...
I20260620 23:03:50.223893 32051 ts_manager.cc:194] Registered new tserver with Master: bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:50.224030 32192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.224146 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.224191 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-1-root
uuid: "77b91cbc17364fb184ef155e79a431db"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.224236 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:50.224634 32051 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36918
I20260620 23:03:50.236212 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:50.236441 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:50.236632 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:50.236855 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:50.236902 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.236944 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:50.236971 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.240471 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.130:46295
I20260620 23:03:50.240530 32255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.130:46295 every 8 connection(s)
I20260620 23:03:50.241000 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:50.242643 32259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:50.242676 32260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:50.242985 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:50.243464 32262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:50.243718 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:50.243778 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:50.243817 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996630243817 us; error 0 us; skew 500 ppm
I20260620 23:03:50.248814 31518 webserver.cc:460] Webserver started at http://127.30.199.131:40617/ using document root <none> and password file <none>
I20260620 23:03:50.248946 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:50.249027 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:50.249085 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:50.249303 32256 heartbeater.cc:347] Connected to a master server at 127.30.199.190:40137
I20260620 23:03:50.249374 32256 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:50.249477 32256 heartbeater.cc:511] Master 127.30.199.190:40137 requested a full tablet report, sending...
I20260620 23:03:50.249491 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-2-root/instance:
uuid: "34ef673cdcb24d1497963e37b2ab7b07"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.249797 32051 ts_manager.cc:194] Registered new tserver with Master: 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295)
I20260620 23:03:50.250363 32051 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36924
I20260620 23:03:50.250788 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:50.251439 32267 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.251669 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.251737 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-2-root
uuid: "34ef673cdcb24d1497963e37b2ab7b07"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:50.251793 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:50.259658 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:50.259912 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:50.260144 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:50.260394 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:50.260445 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.260491 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:50.260521 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:50.264705 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.131:38849
I20260620 23:03:50.264793 32330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.131:38849 every 8 connection(s)
I20260620 23:03:50.268496 32331 heartbeater.cc:347] Connected to a master server at 127.30.199.190:40137
I20260620 23:03:50.268585 32331 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:50.268697 32331 heartbeater.cc:511] Master 127.30.199.190:40137 requested a full tablet report, sending...
I20260620 23:03:50.268918 32051 ts_manager.cc:194] Registered new tserver with Master: 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:50.269237 32051 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36936
I20260620 23:03:50.269450 31518 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004496853s
I20260620 23:03:50.278106 31518 test_util.cc:268] Using random seed: 1814265815
I20260620 23:03:50.283370 32051 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36968:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 23:03:50.283586 32051 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 23:03:50.289081 32220 tablet_service.cc:1467] Processing CreateTablet for tablet 21e399c2958c471fa8ebc5b6df8a190b (DEFAULT_TABLE table=test-workload [id=c62d77295446443f9ed4702206ef2ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:50.289253 32220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21e399c2958c471fa8ebc5b6df8a190b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:50.289744 32144 tablet_service.cc:1467] Processing CreateTablet for tablet 21e399c2958c471fa8ebc5b6df8a190b (DEFAULT_TABLE table=test-workload [id=c62d77295446443f9ed4702206ef2ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:50.289860 32144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21e399c2958c471fa8ebc5b6df8a190b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:50.289863 32295 tablet_service.cc:1467] Processing CreateTablet for tablet 21e399c2958c471fa8ebc5b6df8a190b (DEFAULT_TABLE table=test-workload [id=c62d77295446443f9ed4702206ef2ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:50.290048 32295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21e399c2958c471fa8ebc5b6df8a190b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:50.290956 32352 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Bootstrap starting.
I20260620 23:03:50.291267 32353 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Bootstrap starting.
I20260620 23:03:50.291422 32352 tablet_bootstrap.cc:654] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:50.291728 32353 tablet_bootstrap.cc:654] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:50.292034 32352 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: No bootstrap required, opened a new log
I20260620 23:03:50.292146 32352 ts_tablet_manager.cc:1397] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:50.292230 32354 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Bootstrap starting.
I20260620 23:03:50.292349 32353 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: No bootstrap required, opened a new log
I20260620 23:03:50.292343 32352 raft_consensus.cc:348] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.292438 32352 raft_consensus.cc:374] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:50.292439 32353 ts_tablet_manager.cc:1397] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:50.292510 32352 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Initialized, Role: FOLLOWER
I20260620 23:03:50.292563 32352 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.292639 32353 raft_consensus.cc:348] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.292737 32352 ts_tablet_manager.cc:1428] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:50.292786 32256 heartbeater.cc:503] Master 127.30.199.190:40137 was elected leader, sending a full tablet report...
I20260620 23:03:50.292727 32353 raft_consensus.cc:374] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:50.292739 32354 tablet_bootstrap.cc:654] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:50.292881 32353 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Initialized, Role: FOLLOWER
I20260620 23:03:50.292932 32353 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.293114 32353 ts_tablet_manager.cc:1428] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:50.293135 32180 heartbeater.cc:503] Master 127.30.199.190:40137 was elected leader, sending a full tablet report...
I20260620 23:03:50.293835 32354 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: No bootstrap required, opened a new log
I20260620 23:03:50.293888 32354 ts_tablet_manager.cc:1397] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260620 23:03:50.294018 32354 raft_consensus.cc:348] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.294068 32354 raft_consensus.cc:374] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:50.294082 32354 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Initialized, Role: FOLLOWER
I20260620 23:03:50.294137 32354 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.294287 32354 ts_tablet_manager.cc:1428] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:50.294341 32331 heartbeater.cc:503] Master 127.30.199.190:40137 was elected leader, sending a full tablet report...
I20260620 23:03:50.305696 32358 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 23:03:50.305786 32358 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.306053 32358 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:50.310348 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db" is_pre_election: true
I20260620 23:03:50.310469 32230 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 0.
I20260620 23:03:50.310360 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07" is_pre_election: true
I20260620 23:03:50.310520 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 0.
I20260620 23:03:50.310690 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 
I20260620 23:03:50.310842 32358 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 23:03:50.310916 32358 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:50.310959 32358 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:50.312829 32358 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.312976 32358 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 1 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:50.313084 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:50.313185 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:50.313184 32230 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:50.313333 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:50.313983 32230 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 1.
I20260620 23:03:50.313987 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 1.
I20260620 23:03:50.314170 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 
I20260620 23:03:50.314280 32358 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:50.314425 32358 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:50.314491 32358 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.315060 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 reported cstate change: term changed from 0 to 1, leader changed from <none> to bee0ba2503744c44838b670cd7e0de39 (127.30.199.129). New cstate: current_term: 1 leader_uuid: "bee0ba2503744c44838b670cd7e0de39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:50.326363 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 1 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:50.326378 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 1 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:50.326642 32362 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:50.326807 32362 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:50.328835 32371 mvcc.cc:205] Tried to move back new op lower bound from 7299058197816307712 to 7299058197768761344. Current Snapshot: MvccSnapshot[applied={T|T < 7299058197815332864}]
I20260620 23:03:50.716143 32360 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:50.716248 32360 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:50.717105 32360 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.717351 32360 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 2 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:50.721763 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:50.721941 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:50.722126 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:50.722265 32360 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260620 23:03:50.736554 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 2 FOLLOWER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 1. Current term is 2. Ops: []
I20260620 23:03:50.736852 32362 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 1.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:50.768141 32362 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 LEADER]: Stepping down as leader of term 1
I20260620 23:03:50.768257 32362 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:50.768344 32362 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.768518 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:50.844926 32360 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:50.845027 32360 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:50.846009 32360 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.846243 32360 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 3 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:50.846541 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 3 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:50.846522 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 3 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:50.846732 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:50.847633 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 3.
I20260620 23:03:50.847827 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 
I20260620 23:03:50.847939 32360 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 FOLLOWER]: Leader election won for term 3
I20260620 23:03:50.848037 32360 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 LEADER]: Becoming Leader. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:50.848119 32360 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 17, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.848577 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 reported cstate change: term changed from 1 to 3, leader changed from bee0ba2503744c44838b670cd7e0de39 (127.30.199.129) to 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131). New cstate: current_term: 3 leader_uuid: "34ef673cdcb24d1497963e37b2ab7b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:50.858191 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 1 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:50.858273 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:50.858989 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:50.859216 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 2 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:50.863845 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:50.863894 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 2 candidate_status { last_received { term: 1 index: 17 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:50.864022 32154 raft_consensus.cc:2354] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 2. Current term is 3.
I20260620 23:03:50.864225 32196 leader_election.cc:398] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 2 election: Vote denied by peer bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675) with higher term. Message: Invalid argument: T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 2. Current term is 3.
I20260620 23:03:50.864271 32196 leader_election.cc:401] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260620 23:03:50.864415 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 2 FOLLOWER]: Advancing to term 3
I20260620 23:03:50.865059 32390 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675) with higher term. Message: Invalid argument: T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 2. Current term is 3.
I20260620 23:03:50.935484 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260620 23:03:50.935880 32387 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:50.936136 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 3 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 3 index: 18. (index mismatch)
I20260620 23:03:50.936365 32387 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:51.037490 32362 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:51.037613 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:51.038419 32362 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.038715 32362 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 4 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:51.038954 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.038975 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.039274 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:51.039386 32362 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260620 23:03:51.062263 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 3. Current term is 4. Ops: []
I20260620 23:03:51.062546 32387 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260620 23:03:51.137738 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 3. Current term is 4. Ops: []
I20260620 23:03:51.138111 32398 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 3.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260620 23:03:51.140841 32387 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 LEADER]: Stepping down as leader of term 3
I20260620 23:03:51.140918 32387 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:51.140993 32387 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.141101 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:51.170044 32362 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:51.170166 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:51.171326 32362 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.171557 32362 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 5 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:51.171782 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.171783 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 5 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.171924 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:51.172748 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 5.
I20260620 23:03:51.172936 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:51.173039 32362 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 FOLLOWER]: Leader election won for term 5
I20260620 23:03:51.173092 32362 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:51.173148 32362 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 3.18, Last appended by leader: 18, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.173627 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 reported cstate change: term changed from 3 to 5, leader changed from 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131) to bee0ba2503744c44838b670cd7e0de39 (127.30.199.129). New cstate: current_term: 5 leader_uuid: "bee0ba2503744c44838b670cd7e0de39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:51.212271 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 3 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:51.212368 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 3 FOLLOWER]: Advancing to term 4
I20260620 23:03:51.213165 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.213362 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 4 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:51.213608 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.213608 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 4 candidate_status { last_received { term: 3 index: 18 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:51.213740 32305 raft_consensus.cc:2354] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 4. Current term is 5.
I20260620 23:03:51.213971 32195 leader_election.cc:398] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 4 election: Vote denied by peer 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849) with higher term. Message: Invalid argument: T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 4. Current term is 5.
I20260620 23:03:51.214033 32195 leader_election.cc:401] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260620 23:03:51.214114 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 4 FOLLOWER]: Advancing to term 5
I20260620 23:03:51.214777 32390 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849) with higher term. Message: Invalid argument: T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db for earlier term 4. Current term is 5.
I20260620 23:03:51.266338 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260620 23:03:51.266870 32362 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260620 23:03:51.279753 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 5 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 5 index: 19. (index mismatch)
I20260620 23:03:51.280143 32362 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260620 23:03:51.450412 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:51.450511 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:51.451375 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.451617 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 6 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:51.451830 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:51.451887 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.452164 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:51.452278 32387 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 23:03:51.460587 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 5. Current term is 6. Ops: []
I20260620 23:03:51.460877 32358 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:51.462227 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 5 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:51.462302 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:51.463217 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.463373 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 6 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:51.463532 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:51.463615 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 6 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.463755 32305 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db in current term 6: Already voted for candidate 34ef673cdcb24d1497963e37b2ab7b07 in this term.
I20260620 23:03:51.463940 32195 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db; no voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:51.464066 32390 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260620 23:03:51.475852 32230 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 6 FOLLOWER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 5. Current term is 6. Ops: []
I20260620 23:03:51.476145 32358 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: INVALID_TERM, Last received: 5.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:51.493737 32362 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 LEADER]: Stepping down as leader of term 5
I20260620 23:03:51.493832 32362 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:51.493930 32362 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.494062 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 5 FOLLOWER]: Advancing to term 6
I20260620 23:03:51.580991 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:51.581116 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:51.581881 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.582093 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 7 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:51.582343 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 7 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:51.582402 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 7 candidate_status { last_received { term: 5 index: 19 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.582459 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:51.582466 32230 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 6 FOLLOWER]: Advancing to term 7
I20260620 23:03:51.583276 32230 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 7.
I20260620 23:03:51.583379 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 7.
I20260620 23:03:51.583514 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db; no voters: 
I20260620 23:03:51.583654 32387 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 FOLLOWER]: Leader election won for term 7
I20260620 23:03:51.583725 32387 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 LEADER]: Becoming Leader. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:51.583794 32387 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 5.19, Last appended by leader: 19, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.584452 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 reported cstate change: term changed from 5 to 7, leader changed from bee0ba2503744c44838b670cd7e0de39 (127.30.199.129) to 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131). New cstate: current_term: 7 leader_uuid: "34ef673cdcb24d1497963e37b2ab7b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:51.660470 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 7 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 7 index: 20. (index mismatch)
I20260620 23:03:51.660828 32387 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:51.687430 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 7 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 5 index: 19. Preceding OpId from leader: term: 7 index: 20. (index mismatch)
I20260620 23:03:51.687728 32360 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:51.850894 32362 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:51.851032 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:51.851845 32362 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.852046 32362 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 8 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:51.852293 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.852301 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.852612 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:51.852718 32362 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260620 23:03:51.853336 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 7. Current term is 8. Ops: []
I20260620 23:03:51.853570 32360 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 7.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:51.879832 32387 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 LEADER]: Stepping down as leader of term 7
I20260620 23:03:51.879942 32387 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:51.880053 32387 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.880213 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:51.970268 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 7 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:51.970387 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 7 FOLLOWER]: Advancing to term 8
I20260620 23:03:51.971423 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.971829 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 8 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:51.972008 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.972013 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 8 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:51.972177 32154 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db in current term 8: Already voted for candidate bee0ba2503744c44838b670cd7e0de39 in this term.
I20260620 23:03:51.972720 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 8.
I20260620 23:03:51.972937 32195 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db; no voters: bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:51.973104 32390 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 FOLLOWER]: Leader election won for term 8
I20260620 23:03:51.973227 32390 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 LEADER]: Becoming Leader. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:51.973290 32390 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.973762 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db reported cstate change: term changed from 7 to 8, leader changed from 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131) to 77b91cbc17364fb184ef155e79a431db (127.30.199.130). New cstate: current_term: 8 leader_uuid: "77b91cbc17364fb184ef155e79a431db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:51.994668 32362 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:51.994771 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:51.995529 32362 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:51.995836 32362 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 9 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:51.995950 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 9 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:51.996040 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:51.995963 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 9 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:51.996860 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 9.
I20260620 23:03:51.997082 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:51.997218 32362 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 FOLLOWER]: Leader election won for term 9
I20260620 23:03:51.997380 32362 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:51.997449 32362 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 7.20, Last appended by leader: 20, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.008841 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 reported cstate change: term changed from 8 to 9, leader changed from 77b91cbc17364fb184ef155e79a431db (127.30.199.130) to bee0ba2503744c44838b670cd7e0de39 (127.30.199.129). New cstate: current_term: 9 leader_uuid: "bee0ba2503744c44838b670cd7e0de39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:52.085736 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 9 FOLLOWER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 8. Current term is 9. Ops: []
I20260620 23:03:52.086098 32390 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:52.087092 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 LEADER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 8. Current term is 9. Ops: []
I20260620 23:03:52.087355 32401 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:52.087463 32401 consensus_queue.cc:1225] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer bee0ba2503744c44838b670cd7e0de39 log is divergent from this leader: its last log entry 9.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260620 23:03:52.106026 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.106129 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 9 FOLLOWER]: Advancing to term 10
I20260620 23:03:52.106809 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.107023 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 10 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.107250 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 10 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.107328 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 10 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.107630 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.107760 32387 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260620 23:03:52.116009 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 10 FOLLOWER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 9. Current term is 10. Ops: []
I20260620 23:03:52.116382 32362 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:52.119879 32230 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 LEADER]: Stepping down as leader of term 8
I20260620 23:03:52.119941 32230 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:52.120013 32230 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 8.21, Last appended by leader: 21, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.120170 32230 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 8 FOLLOWER]: Advancing to term 9
I20260620 23:03:52.120827 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 9 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 8 index: 21. Preceding OpId from leader: term: 9 index: 21. (term mismatch)
I20260620 23:03:52.120865 32230 pending_rounds.cc:76] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Aborting all ops after (but not including) 20
I20260620 23:03:52.120878 32230 pending_rounds.cc:97] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Aborting uncommitted NO_OP operation due to leader change: 8.21
I20260620 23:03:52.120893 32230 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:52.121155 32402 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:52.163606 32362 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 LEADER]: Stepping down as leader of term 9
I20260620 23:03:52.163702 32362 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:52.163792 32362 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 9.21, Last appended by leader: 21, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.163918 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 9 FOLLOWER]: Advancing to term 10
I20260620 23:03:52.209306 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.209405 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 10 FOLLOWER]: Advancing to term 11
I20260620 23:03:52.210042 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.210258 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 11 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.210500 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 11 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.210538 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 11 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.210613 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 10 FOLLOWER]: Advancing to term 11
I20260620 23:03:52.211233 32154 raft_consensus.cc:2396] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 34ef673cdcb24d1497963e37b2ab7b07 for term 11 because replica has last-logged OpId of term: 9 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 20.
I20260620 23:03:52.211433 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.211534 32387 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260620 23:03:52.219028 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.220273 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.222481 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.226697 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.234917 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.251235 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.283564 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.336186 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.336288 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 11 FOLLOWER]: Advancing to term 12
I20260620 23:03:52.337007 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.337216 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 12 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.337577 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 12 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.337673 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 11 FOLLOWER]: Advancing to term 12
I20260620 23:03:52.337661 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 12 candidate_status { last_received { term: 7 index: 20 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.337929 32230 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 9 FOLLOWER]: Advancing to term 12
I20260620 23:03:52.338481 32154 raft_consensus.cc:2396] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34ef673cdcb24d1497963e37b2ab7b07 for term 12 because replica has last-logged OpId of term: 9 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 20.
I20260620 23:03:52.338649 32230 raft_consensus.cc:2396] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 34ef673cdcb24d1497963e37b2ab7b07 for term 12 because replica has last-logged OpId of term: 9 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 20.
I20260620 23:03:52.338840 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.338945 32387 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260620 23:03:52.346060 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.346145 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:52.346752 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.346926 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 13 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.347126 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 13 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.347218 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:52.347121 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 13 candidate_status { last_received { term: 9 index: 21 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:52.347311 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 12 FOLLOWER]: Advancing to term 13
I20260620 23:03:52.347822 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.347823 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 13.
I20260620 23:03:52.347923 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 13.
I20260620 23:03:52.348096 32196 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39; no voters: 
I20260620 23:03:52.348177 32390 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 FOLLOWER]: Leader election won for term 13
I20260620 23:03:52.348273 32390 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 LEADER]: Becoming Leader. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:52.348315 32390 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 9.21, Last appended by leader: 21, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.348748 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db reported cstate change: term changed from 9 to 13, leader changed from bee0ba2503744c44838b670cd7e0de39 (127.30.199.129) to 77b91cbc17364fb184ef155e79a431db (127.30.199.130). New cstate: current_term: 13 leader_uuid: "77b91cbc17364fb184ef155e79a431db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:52.433571 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 13 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 9 index: 21. Preceding OpId from leader: term: 13 index: 22. (index mismatch)
I20260620 23:03:52.434080 32390 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260620 23:03:52.435303 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 13 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 7 index: 20. Preceding OpId from leader: term: 13 index: 22. (index mismatch)
I20260620 23:03:52.435497 32404 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:52.476161 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.536507 32362 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77b91cbc17364fb184ef155e79a431db)
I20260620 23:03:52.536610 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:52.537086 32406 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 77b91cbc17364fb184ef155e79a431db)
I20260620 23:03:52.537154 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:52.537504 32362 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.537678 32362 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 14 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:52.537972 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 14 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.538000 32406 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.537979 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 14 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:52.538192 32305 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate bee0ba2503744c44838b670cd7e0de39 in current term 14: Already voted for candidate 34ef673cdcb24d1497963e37b2ab7b07 in this term.
I20260620 23:03:52.538317 32406 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 14 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.538296 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 14 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.538405 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:52.538477 32362 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 23:03:52.538570 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 14 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.538707 32154 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 34ef673cdcb24d1497963e37b2ab7b07 in current term 14: Already voted for candidate bee0ba2503744c44838b670cd7e0de39 in this term.
I20260620 23:03:52.538916 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.539007 32406 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260620 23:03:52.541754 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 13. Current term is 14. Ops: []
I20260620 23:03:52.541981 32404 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 13.22, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260620 23:03:52.542208 32404 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 LEADER]: Stepping down as leader of term 13
I20260620 23:03:52.542279 32404 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:52.542353 32404 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 13.22, Last appended by leader: 22, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.542483 32404 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 13 FOLLOWER]: Advancing to term 14
I20260620 23:03:52.649686 32406 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.649793 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:52.650552 32406 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.650777 32406 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 15 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.651031 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 15 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.651031 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 15 candidate_status { last_received { term: 13 index: 22 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.651135 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:52.651163 32230 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 14 FOLLOWER]: Advancing to term 15
I20260620 23:03:52.651778 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 15.
I20260620 23:03:52.651778 32230 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 15.
I20260620 23:03:52.651995 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db; no voters: 
I20260620 23:03:52.652133 32406 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 FOLLOWER]: Leader election won for term 15
I20260620 23:03:52.652199 32406 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 LEADER]: Becoming Leader. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:52.652235 32406 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 13.22, Last appended by leader: 22, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.652721 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 reported cstate change: term changed from 13 to 15, leader changed from 77b91cbc17364fb184ef155e79a431db (127.30.199.130) to 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131). New cstate: current_term: 15 leader_uuid: "34ef673cdcb24d1497963e37b2ab7b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:52.732420 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:52.752493 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 15 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 13 index: 22. Preceding OpId from leader: term: 15 index: 23. (index mismatch)
I20260620 23:03:52.752840 32406 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260620 23:03:52.754135 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 15 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 13 index: 22. Preceding OpId from leader: term: 15 index: 23. (index mismatch)
I20260620 23:03:52.754328 32406 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260620 23:03:52.854740 32404 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:52.854854 32404 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:52.855937 32404 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.856199 32404 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 16 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.856544 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 16 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:52.856877 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 16 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.857061 32196 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db; no voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.857177 32404 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260620 23:03:52.862288 32230 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 15. Current term is 16. Ops: []
I20260620 23:03:52.862545 32407 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: INVALID_TERM, Last received: 15.23, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:52.862775 32387 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 LEADER]: Stepping down as leader of term 15
I20260620 23:03:52.862819 32387 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:52.862897 32387 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 15.23, Last appended by leader: 23, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.863008 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:52.943478 32408 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:52.943585 32408 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 15 FOLLOWER]: Advancing to term 16
I20260620 23:03:52.944422 32408 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.944621 32408 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 16 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:52.944880 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 16 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:52.944913 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 16 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:52.945083 32230 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate bee0ba2503744c44838b670cd7e0de39 in current term 16: Already voted for candidate 77b91cbc17364fb184ef155e79a431db in this term.
I20260620 23:03:52.945590 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 16.
I20260620 23:03:52.945812 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:52.945909 32408 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 FOLLOWER]: Leader election won for term 16
I20260620 23:03:52.945969 32408 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:52.946003 32408 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 15.23, Last appended by leader: 23, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.946493 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 reported cstate change: term changed from 15 to 16, leader changed from 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131) to bee0ba2503744c44838b670cd7e0de39 (127.30.199.129). New cstate: current_term: 16 leader_uuid: "bee0ba2503744c44838b670cd7e0de39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:52.983129 32404 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:52.983229 32404 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:52.983915 32404 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.984138 32404 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 17 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:52.984362 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 17 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:52.984458 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:52.984376 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 17 candidate_status { last_received { term: 15 index: 23 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:52.985131 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 17.
I20260620 23:03:52.985309 32195 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db; no voters: bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:52.985416 32404 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 FOLLOWER]: Leader election won for term 17
I20260620 23:03:52.985488 32404 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 LEADER]: Becoming Leader. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:52.985550 32404 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 15.23, Last appended by leader: 23, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:52.986049 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db reported cstate change: term changed from 16 to 17, leader changed from bee0ba2503744c44838b670cd7e0de39 (127.30.199.129) to 77b91cbc17364fb184ef155e79a431db (127.30.199.130). New cstate: current_term: 17 leader_uuid: "77b91cbc17364fb184ef155e79a431db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:53.026357 32230 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 LEADER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 16. Current term is 17. Ops: []
I20260620 23:03:53.026856 32408 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:53.027007 32408 consensus_queue.cc:1225] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer 77b91cbc17364fb184ef155e79a431db log is divergent from this leader: its last log entry 17.24 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 23
I20260620 23:03:53.027065 32362 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 LEADER]: Stepping down as leader of term 16
I20260620 23:03:53.027145 32362 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:53.027218 32362 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 16.24, Last appended by leader: 24, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.027333 32362 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 16 FOLLOWER]: Advancing to term 17
I20260620 23:03:53.078811 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 17 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 15 index: 23. Preceding OpId from leader: term: 17 index: 24. (index mismatch)
I20260620 23:03:53.079111 32404 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:53.080375 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 17 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 16 index: 24. Preceding OpId from leader: term: 17 index: 24. (term mismatch)
I20260620 23:03:53.080435 32154 pending_rounds.cc:76] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Aborting all ops after (but not including) 23
I20260620 23:03:53.080475 32154 pending_rounds.cc:97] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Aborting uncommitted NO_OP operation due to leader change: 16.24
I20260620 23:03:53.080495 32154 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:53.080689 32404 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:53.181348 32387 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 77b91cbc17364fb184ef155e79a431db)
I20260620 23:03:53.181468 32387 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:53.182179 32387 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.182449 32387 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 18 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:53.182667 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 18 candidate_status { last_received { term: 17 index: 24 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:53.182823 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 18 candidate_status { last_received { term: 17 index: 24 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:53.182924 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:53.183588 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 18.
I20260620 23:03:53.183799 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:53.183915 32387 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 FOLLOWER]: Leader election won for term 18
I20260620 23:03:53.183986 32387 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 LEADER]: Becoming Leader. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:53.184024 32387 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 17.24, Last appended by leader: 24, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.184518 32048 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 reported cstate change: term changed from 17 to 18, leader changed from 77b91cbc17364fb184ef155e79a431db (127.30.199.130) to 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131). New cstate: current_term: 18 leader_uuid: "34ef673cdcb24d1497963e37b2ab7b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:53.194943 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 18 FOLLOWER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 17. Current term is 18. Ops: []
I20260620 23:03:53.195222 32409 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 17.24, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260620 23:03:53.195369 32409 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 LEADER]: Stepping down as leader of term 17
I20260620 23:03:53.195420 32409 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:53.195478 32409 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 17.24, Last appended by leader: 24, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.195626 32409 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 17 FOLLOWER]: Advancing to term 18
I20260620 23:03:53.244755 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:53.283507 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 18 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 17 index: 24. Preceding OpId from leader: term: 18 index: 25. (index mismatch)
I20260620 23:03:53.283849 32387 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260620 23:03:53.285280 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 18 FOLLOWER]: Refusing update from remote peer 34ef673cdcb24d1497963e37b2ab7b07: Log matching property violated. Preceding OpId in replica: term: 17 index: 24. Preceding OpId from leader: term: 18 index: 25. (index mismatch)
I20260620 23:03:53.285478 32387 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260620 23:03:53.471199 32408 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:53.471329 32408 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:53.472189 32408 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.472491 32408 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 19 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:53.472596 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 19 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:53.472687 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 19 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:53.472934 32118 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:53.473070 32408 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260620 23:03:53.484669 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 18. Current term is 19. Ops: []
I20260620 23:03:53.484994 32406 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 18.25, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:53.485119 32406 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 LEADER]: Stepping down as leader of term 18
I20260620 23:03:53.485140 32406 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:53.485210 32406 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 18.25, Last appended by leader: 25, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.485320 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:53.494728 32409 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 18 FOLLOWER]: Starting leader election (detected failure of leader 34ef673cdcb24d1497963e37b2ab7b07)
I20260620 23:03:53.494876 32409 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 18 FOLLOWER]: Advancing to term 19
I20260620 23:03:53.495678 32409 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.495910 32409 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 19 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:53.496186 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 19 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:53.496199 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 19 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:53.496311 32154 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 77b91cbc17364fb184ef155e79a431db in current term 19: Already voted for candidate bee0ba2503744c44838b670cd7e0de39 in this term.
I20260620 23:03:53.496882 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 19.
I20260620 23:03:53.497079 32195 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db; no voters: bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:53.497191 32409 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 FOLLOWER]: Leader election won for term 19
I20260620 23:03:53.497247 32409 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 LEADER]: Becoming Leader. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:53.497387 32409 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 18.25, Last appended by leader: 25, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.497903 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db reported cstate change: term changed from 18 to 19, leader changed from 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131) to 77b91cbc17364fb184ef155e79a431db (127.30.199.130). New cstate: current_term: 19 leader_uuid: "77b91cbc17364fb184ef155e79a431db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:53.574911 32408 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:53.575067 32408 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:53.575826 32408 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.576113 32408 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 20 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:53.576349 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 20 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:53.576344 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 20 candidate_status { last_received { term: 18 index: 25 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:53.576499 32305 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:53.577108 32305 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 20.
I20260620 23:03:53.577354 32119 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:53.577576 32408 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 FOLLOWER]: Leader election won for term 20
I20260620 23:03:53.577682 32408 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:53.577762 32408 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 18.25, Last appended by leader: 25, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.578336 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 reported cstate change: term changed from 19 to 20, leader changed from 77b91cbc17364fb184ef155e79a431db (127.30.199.130) to bee0ba2503744c44838b670cd7e0de39 (127.30.199.129). New cstate: current_term: 20 leader_uuid: "bee0ba2503744c44838b670cd7e0de39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:53.596681 32154 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 LEADER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 19. Current term is 20. Ops: []
I20260620 23:03:53.596990 32409 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: INVALID_TERM, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:53.597167 32409 consensus_queue.cc:1225] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer bee0ba2503744c44838b670cd7e0de39 log is divergent from this leader: its last log entry 20.26 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 25
I20260620 23:03:53.597250 32390 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 LEADER]: Stepping down as leader of term 19
I20260620 23:03:53.597333 32390 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:53.597414 32390 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 19.26, Last appended by leader: 26, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.597522 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 19 FOLLOWER]: Advancing to term 20
I20260620 23:03:53.691174 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 20 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 18 index: 25. Preceding OpId from leader: term: 20 index: 26. (index mismatch)
I20260620 23:03:53.691586 32408 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:53.692757 32230 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 20 FOLLOWER]: Refusing update from remote peer bee0ba2503744c44838b670cd7e0de39: Log matching property violated. Preceding OpId in replica: term: 19 index: 26. Preceding OpId from leader: term: 20 index: 26. (term mismatch)
I20260620 23:03:53.692816 32230 pending_rounds.cc:76] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Aborting all ops after (but not including) 25
I20260620 23:03:53.692836 32230 pending_rounds.cc:97] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: Aborting uncommitted NO_OP operation due to leader change: 19.26
I20260620 23:03:53.692855 32230 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:53.693007 32408 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:53.890817 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:53.890918 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:53.891695 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.891888 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 21 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:53.892198 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 21 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:53.892198 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 21 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:53.892467 32195 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db; no voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:53.892597 32390 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260620 23:03:53.902863 32230 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Rejecting Update request from peer bee0ba2503744c44838b670cd7e0de39 for earlier term 20. Current term is 21. Ops: []
I20260620 23:03:53.903211 32410 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: INVALID_TERM, Last received: 20.26, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:53.903342 32410 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 LEADER]: Stepping down as leader of term 20
I20260620 23:03:53.903363 32410 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:53.903447 32410 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 20.26, Last appended by leader: 26, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.903553 32410 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:53.969699 32406 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 20 FOLLOWER]: Starting leader election (detected failure of leader bee0ba2503744c44838b670cd7e0de39)
I20260620 23:03:53.969811 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 20 FOLLOWER]: Advancing to term 21
I20260620 23:03:53.970661 32406 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.970894 32406 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 21 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:53.971115 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 21 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:53.971259 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 21 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:53.971387 32230 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 34ef673cdcb24d1497963e37b2ab7b07 in current term 21: Already voted for candidate 77b91cbc17364fb184ef155e79a431db in this term.
I20260620 23:03:53.971879 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 34ef673cdcb24d1497963e37b2ab7b07 in term 21.
I20260620 23:03:53.972107 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07, bee0ba2503744c44838b670cd7e0de39; no voters: 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:53.972205 32406 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 FOLLOWER]: Leader election won for term 21
I20260620 23:03:53.972267 32406 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 LEADER]: Becoming Leader. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:53.972321 32406 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 20.26, Last appended by leader: 26, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:53.972819 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 reported cstate change: term changed from 20 to 21, leader changed from bee0ba2503744c44838b670cd7e0de39 (127.30.199.129) to 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131). New cstate: current_term: 21 leader_uuid: "34ef673cdcb24d1497963e37b2ab7b07" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:54.004205 32390 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:54.004308 32390 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:54.005024 32390 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.005219 32390 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 22 election: Requested vote from peers 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:54.005463 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 22 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:54.005463 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "77b91cbc17364fb184ef155e79a431db" candidate_term: 22 candidate_status { last_received { term: 20 index: 26 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:54.005581 32154 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:54.006148 32154 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77b91cbc17364fb184ef155e79a431db in term 22.
I20260620 23:03:54.006348 32196 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07
I20260620 23:03:54.006461 32390 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 FOLLOWER]: Leader election won for term 22
I20260620 23:03:54.006523 32390 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 LEADER]: Becoming Leader. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:54.006608 32390 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 20.26, Last appended by leader: 26, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.007138 32049 catalog_manager.cc:5495] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db reported cstate change: term changed from 21 to 22, leader changed from 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131) to 77b91cbc17364fb184ef155e79a431db (127.30.199.130). New cstate: current_term: 22 leader_uuid: "77b91cbc17364fb184ef155e79a431db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:54.048280 32230 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 LEADER]: Rejecting Update request from peer 34ef673cdcb24d1497963e37b2ab7b07 for earlier term 21. Current term is 22. Ops: []
I20260620 23:03:54.048609 32406 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 }, Status: INVALID_TERM, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:54.048732 32406 consensus_queue.cc:1225] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [LEADER]: Peer 77b91cbc17364fb184ef155e79a431db log is divergent from this leader: its last log entry 22.27 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 26
I20260620 23:03:54.048758 32406 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 LEADER]: Stepping down as leader of term 21
I20260620 23:03:54.048774 32406 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 34ef673cdcb24d1497963e37b2ab7b07, State: Running, Role: LEADER
I20260620 23:03:54.048836 32406 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 21.27, Last appended by leader: 27, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.048907 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 21 FOLLOWER]: Advancing to term 22
I20260620 23:03:54.096269 32305 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 22 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 21 index: 27. Preceding OpId from leader: term: 22 index: 27. (term mismatch)
I20260620 23:03:54.096403 32305 pending_rounds.cc:76] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Aborting all ops after (but not including) 26
I20260620 23:03:54.096448 32305 pending_rounds.cc:97] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: Aborting uncommitted NO_OP operation due to leader change: 21.27
I20260620 23:03:54.096486 32305 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260620 23:03:54.096800 32390 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:54.097985 32154 raft_consensus.cc:1261] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 22 FOLLOWER]: Refusing update from remote peer 77b91cbc17364fb184ef155e79a431db: Log matching property violated. Preceding OpId in replica: term: 20 index: 26. Preceding OpId from leader: term: 22 index: 27. (index mismatch)
I20260620 23:03:54.098310 32390 consensus_queue.cc:1035] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Connected to new peer: Peer: permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:54.245070 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:54.245287 31518 log_reader.cc:386] T 21e399c2958c471fa8ebc5b6df8a190b: removed 1 log segments from log reader
I20260620 23:03:54.245361 31518 log.cc:1076] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Deleting log segment in path: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root/wals/21e399c2958c471fa8ebc5b6df8a190b/wal-000000001 (ops 1-17)
I20260620 23:03:54.246047 31518 timestamp_advancement-itest.cc:268] Shutting down cluster...
I20260620 23:03:54.246109 31518 master.cc:537] Master@127.30.199.190:40137 shutting down...
I20260620 23:03:54.359438 32406 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 77b91cbc17364fb184ef155e79a431db)
I20260620 23:03:54.359549 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:54.360405 32406 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.360610 32406 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 23 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
I20260620 23:03:54.360867 32154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 23 candidate_status { last_received { term: 22 index: 27 } } ignore_live_leader: false dest_uuid: "bee0ba2503744c44838b670cd7e0de39"
I20260620 23:03:54.360891 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "34ef673cdcb24d1497963e37b2ab7b07" candidate_term: 23 candidate_status { last_received { term: 22 index: 27 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:54.361256 32269 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:54.361454 32406 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260620 23:03:54.364180 32305 raft_consensus.cc:1226] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Rejecting Update request from peer 77b91cbc17364fb184ef155e79a431db for earlier term 22. Current term is 23. Ops: []
I20260620 23:03:54.364534 32411 consensus_queue.cc:1046] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 }, Status: INVALID_TERM, Last received: 22.27, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260620 23:03:54.364672 32411 raft_consensus.cc:3032] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 LEADER]: Stepping down as leader of term 22
I20260620 23:03:54.364717 32411 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 77b91cbc17364fb184ef155e79a431db, State: Running, Role: LEADER
I20260620 23:03:54.364794 32411 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 22.27, Last appended by leader: 27, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.364884 32411 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:54.383342 32410 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 77b91cbc17364fb184ef155e79a431db)
I20260620 23:03:54.383440 32410 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 22 FOLLOWER]: Advancing to term 23
I20260620 23:03:54.384197 32410 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.384414 32410 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 23 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
I20260620 23:03:54.384688 32230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 23 candidate_status { last_received { term: 22 index: 27 } } ignore_live_leader: false dest_uuid: "77b91cbc17364fb184ef155e79a431db"
I20260620 23:03:54.384699 32305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21e399c2958c471fa8ebc5b6df8a190b" candidate_uuid: "bee0ba2503744c44838b670cd7e0de39" candidate_term: 23 candidate_status { last_received { term: 22 index: 27 } } ignore_live_leader: false dest_uuid: "34ef673cdcb24d1497963e37b2ab7b07"
I20260620 23:03:54.384840 32305 raft_consensus.cc:2379] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate bee0ba2503744c44838b670cd7e0de39 in current term 23: Already voted for candidate 34ef673cdcb24d1497963e37b2ab7b07 in this term.
I20260620 23:03:54.385385 32230 raft_consensus.cc:2454] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bee0ba2503744c44838b670cd7e0de39 in term 23.
I20260620 23:03:54.385658 32118 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07
I20260620 23:03:54.385802 32410 raft_consensus.cc:2781] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Leader election won for term 23
I20260620 23:03:54.385864 32410 raft_consensus.cc:686] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 LEADER]: Becoming Leader. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Running, Role: LEADER
I20260620 23:03:54.385919 32410 consensus_queue.cc:237] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 22.27, Last appended by leader: 27, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
W20260620 23:03:54.386642 32180 heartbeater.cc:644] Failed to heartbeat to 127.30.199.190:40137 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20260620 23:03:54.407188 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:54.407320 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:54.407349 31518 tablet_replica.cc:330] T 00000000000000000000000000000000 P 39e1a3b4c63645b295e98183ad024fa9: stopping tablet replica
I20260620 23:03:54.420174 31518 master.cc:552] Master@127.30.199.190:40137 shutdown complete.
I20260620 23:03:54.421722 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:54.471084 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:54.471298 31518 tablet_replica.cc:330] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: stopping tablet replica
I20260620 23:03:54.471379 31518 raft_consensus.cc:2229] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 LEADER]: Raft consensus shutting down.
I20260620 23:03:54.471473 31518 pending_rounds.cc:62] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Trying to abort 1 pending ops.
I20260620 23:03:54.471515 31518 pending_rounds.cc:68] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Aborting op as it isn't in flight: id { term: 23 index: 28 } timestamp: 7299058214445309952 op_type: NO_OP noop_request { }
I20260620 23:03:54.471583 31518 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260620 23:03:54.471613 31518 raft_consensus.cc:2258] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:54.473802 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:54.474845 31518 tablet_server.cc:178] TabletServer@127.30.199.130:0 shutting down...
I20260620 23:03:54.480942 32406 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:54.481015 32406 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 23 FOLLOWER]: Advancing to term 24
I20260620 23:03:54.481678 32406 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.481861 32406 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 24 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675)
W20260620 23:03:54.482399 32269 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260620 23:03:54.482705 32271 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer bee0ba2503744c44838b670cd7e0de39 (127.30.199.129:42675): Network error: Client connection negotiation failed: client connection to 127.30.199.129:42675: connect: Connection refused (error 111)
I20260620 23:03:54.482760 32271 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 34ef673cdcb24d1497963e37b2ab7b07; no voters: 77b91cbc17364fb184ef155e79a431db, bee0ba2503744c44838b670cd7e0de39
I20260620 23:03:54.483954 32406 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260620 23:03:54.493224 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:54.493397 31518 tablet_replica.cc:330] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db: stopping tablet replica
I20260620 23:03:54.493492 31518 raft_consensus.cc:2229] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 23 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:54.493568 31518 raft_consensus.cc:2258] T 21e399c2958c471fa8ebc5b6df8a190b P 77b91cbc17364fb184ef155e79a431db [term 23 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:54.506228 31518 tablet_server.cc:194] TabletServer@127.30.199.130:0 shutdown complete.
I20260620 23:03:54.507187 31518 tablet_server.cc:178] TabletServer@127.30.199.131:0 shutting down...
I20260620 23:03:54.517354 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:54.517562 31518 tablet_replica.cc:330] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07: stopping tablet replica
I20260620 23:03:54.517629 31518 raft_consensus.cc:2229] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:54.517671 31518 raft_consensus.cc:2258] T 21e399c2958c471fa8ebc5b6df8a190b P 34ef673cdcb24d1497963e37b2ab7b07 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:54.519786 31518 tablet_server.cc:194] TabletServer@127.30.199.131:0 shutdown complete.
I20260620 23:03:54.520746 31518 timestamp_advancement-itest.cc:276] Restarting single tablet server...
I20260620 23:03:54.520860 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:54.522230 32414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.522269 32415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.522281 32417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.522269 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:54.522560 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:54.522586 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:54.522598 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996634522599 us; error 0 us; skew 500 ppm
I20260620 23:03:54.523229 31518 webserver.cc:460] Webserver started at http://127.30.199.129:39223/ using document root <none> and password file <none>
I20260620 23:03:54.523299 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:54.523325 31518 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 23:03:54.523926 31518 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:54.525509 32425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.525635 31518 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:54.525705 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "bee0ba2503744c44838b670cd7e0de39"
format_stamp: "Formatted at 2026-06-20 23:03:50 on dist-test-slave-z4c6"
I20260620 23:03:54.525782 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5321
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:54.537568 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:54.537812 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:54.537999 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:54.538359 32432 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 23:03:54.539309 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 23:03:54.539376 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:54.539425 31518 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 23:03:54.539876 31518 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 23:03:54.539932 32432 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Bootstrap starting.
I20260620 23:03:54.539932 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:54.541846 32432 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260620 23:03:54.542146 32432 tablet_bootstrap.cc:492] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Bootstrap complete.
I20260620 23:03:54.542270 32432 ts_tablet_manager.cc:1397] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260620 23:03:54.542426 32432 raft_consensus.cc:348] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.542531 32432 raft_consensus.cc:729] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee0ba2503744c44838b670cd7e0de39, State: Initialized, Role: FOLLOWER
I20260620 23:03:54.542588 32432 consensus_queue.cc:260] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 27, Last appended: 23.28, Last appended by leader: 28, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.542770 32432 ts_tablet_manager.cc:1428] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Time spent starting tablet: real 0.000s	user 0.002s	sys 0.000s
I20260620 23:03:54.543638 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:42675
I20260620 23:03:54.545694 32491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:42675 every 8 connection(s)
W20260620 23:03:54.546322 32492 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260620 23:03:54.553860 31518 tablet_server.cc:178] TabletServer@127.30.199.129:42675 shutting down...
I20260620 23:03:54.637190 32477 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:54.637420 32477 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 23 FOLLOWER]: Advancing to term 24
I20260620 23:03:54.638243 32477 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.638489 32477 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 24 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
W20260620 23:03:54.639303 32428 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849): Network error: Client connection negotiation failed: client connection to 127.30.199.131:38849: connect: Connection refused (error 111)
W20260620 23:03:54.639384 32427 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295): Network error: Client connection negotiation failed: client connection to 127.30.199.130:46295: connect: Connection refused (error 111)
I20260620 23:03:54.639427 32427 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:54.639495 32477 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260620 23:03:54.748400 32477 raft_consensus.cc:482] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:54.748502 32477 raft_consensus.cc:3037] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 24 FOLLOWER]: Advancing to term 25
I20260620 23:03:54.749238 32477 raft_consensus.cc:504] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77b91cbc17364fb184ef155e79a431db" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 46295 } } peers { permanent_uuid: "34ef673cdcb24d1497963e37b2ab7b07" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 38849 } } peers { permanent_uuid: "bee0ba2503744c44838b670cd7e0de39" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 42675 } }
I20260620 23:03:54.749425 32477 leader_election.cc:288] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 25 election: Requested vote from peers 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295), 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849)
W20260620 23:03:54.750290 32428 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 34ef673cdcb24d1497963e37b2ab7b07 (127.30.199.131:38849): Network error: Client connection negotiation failed: client connection to 127.30.199.131:38849: connect: Connection refused (error 111)
W20260620 23:03:54.750365 32427 leader_election.cc:334] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 77b91cbc17364fb184ef155e79a431db (127.30.199.130:46295): Network error: Client connection negotiation failed: client connection to 127.30.199.130:46295: connect: Connection refused (error 111)
I20260620 23:03:54.750412 32427 leader_election.cc:302] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bee0ba2503744c44838b670cd7e0de39; no voters: 34ef673cdcb24d1497963e37b2ab7b07, 77b91cbc17364fb184ef155e79a431db
I20260620 23:03:54.750553 32477 raft_consensus.cc:2726] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260620 23:03:54.794687 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:54.794977 31518 tablet_replica.cc:330] stopping tablet replica
I20260620 23:03:54.795054 31518 raft_consensus.cc:2229] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:54.795121 31518 pending_rounds.cc:62] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Trying to abort 1 pending ops.
I20260620 23:03:54.795151 31518 pending_rounds.cc:68] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39: Aborting op as it isn't in flight: id { term: 23 index: 28 } timestamp: 7299058214445309952 op_type: NO_OP noop_request { }
I20260620 23:03:54.795243 31518 raft_consensus.cc:2866] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260620 23:03:54.795279 31518 raft_consensus.cc:2258] T 21e399c2958c471fa8ebc5b6df8a190b P bee0ba2503744c44838b670cd7e0de39 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:54.807346 31518 tablet_server.cc:194] TabletServer@127.30.199.129:42675 shutdown complete.
[       OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (4685 ms)
[ RUN      ] TimestampAdvancementITest.Kudu2463Test
I20260620 23:03:54.812706 31518 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.199.190:46511
I20260620 23:03:54.812868 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:54.814240 32500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.814308 32502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.814392 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:54.814251 32499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.814607 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:54.814647 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:54.814661 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996634814660 us; error 0 us; skew 500 ppm
I20260620 23:03:54.815375 31518 webserver.cc:460] Webserver started at http://127.30.199.190:37551/ using document root <none> and password file <none>
I20260620 23:03:54.815469 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:54.815498 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:54.815527 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:54.815820 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/master-0-root/instance:
uuid: "66bc760b209a455384794e6852803211"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.816859 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:54.817414 32507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.817539 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:54.817586 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/master-0-root
uuid: "66bc760b209a455384794e6852803211"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.817639 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:54.835394 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:54.835585 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:54.838876 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.190:46511
I20260620 23:03:54.839075 32559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.190:46511 every 8 connection(s)
I20260620 23:03:54.839689 32560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:54.840793 32560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211: Bootstrap starting.
I20260620 23:03:54.841125 32560 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:54.844429 32560 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211: No bootstrap required, opened a new log
I20260620 23:03:54.844583 32560 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER }
I20260620 23:03:54.844646 32560 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:54.844660 32560 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66bc760b209a455384794e6852803211, State: Initialized, Role: FOLLOWER
I20260620 23:03:54.844727 32560 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER }
I20260620 23:03:54.844765 32560 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:54.844786 32560 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:54.844811 32560 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:54.845314 32560 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER }
I20260620 23:03:54.845372 32560 leader_election.cc:302] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66bc760b209a455384794e6852803211; no voters: 
I20260620 23:03:54.845534 32560 leader_election.cc:288] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 23:03:54.845682 32560 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 23:03:54.845649 32563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:54.845921 32563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 1 LEADER]: Becoming Leader. State: Replica: 66bc760b209a455384794e6852803211, State: Running, Role: LEADER
I20260620 23:03:54.846088 32563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER }
I20260620 23:03:54.846295 32564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66bc760b209a455384794e6852803211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER } }
I20260620 23:03:54.846356 32564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:54.846508 32565 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66bc760b209a455384794e6852803211. Latest consensus state: current_term: 1 leader_uuid: "66bc760b209a455384794e6852803211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66bc760b209a455384794e6852803211" member_type: VOTER } }
I20260620 23:03:54.846560 32565 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:54.846632 32572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 23:03:54.846766 32572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 23:03:54.847115 31518 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 23:03:54.847968 32572 catalog_manager.cc:1347] Generated new cluster ID: 05a9971b69494700a87c43b81f20ff2e
I20260620 23:03:54.848014 32572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 23:03:54.879704 32572 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 23:03:54.880183 32572 catalog_manager.cc:1504] Loading token signing keys...
I20260620 23:03:54.884604 32572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211: Generated new TSK 0
I20260620 23:03:54.884696 32572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 23:03:54.911079 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:54.912533 32581 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.912637 32582 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.912739 32584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.913190 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:54.913326 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:54.913363 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:54.913378 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996634913377 us; error 0 us; skew 500 ppm
I20260620 23:03:54.914124 31518 webserver.cc:460] Webserver started at http://127.30.199.129:36997/ using document root <none> and password file <none>
I20260620 23:03:54.914230 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:54.914283 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:54.914333 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:54.914640 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root/instance:
uuid: "9edaf0e9491c4832bf67dbde3c14ce41"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.915632 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:54.916236 32589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.916370 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.916421 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "9edaf0e9491c4832bf67dbde3c14ce41"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.916482 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:54.922204 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:54.922384 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:54.922523 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:54.922745 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:54.922775 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.922832 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:54.922860 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.925915 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:40939
I20260620 23:03:54.925942 32652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:40939 every 8 connection(s)
I20260620 23:03:54.926386 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:54.927947 32660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.927943 32657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.928202 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:54.928278 32658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.928448 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:54.928506 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:54.928526 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996634928526 us; error 0 us; skew 500 ppm
I20260620 23:03:54.929193 31518 webserver.cc:460] Webserver started at http://127.30.199.130:37473/ using document root <none> and password file <none>
I20260620 23:03:54.929287 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:54.929333 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:54.929382 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:54.929737 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-1-root/instance:
uuid: "365b663cc5144a3c95e759f2f1c1183a"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.930768 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.001s
I20260620 23:03:54.930790 32653 heartbeater.cc:347] Connected to a master server at 127.30.199.190:46511
I20260620 23:03:54.930871 32653 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:54.930956 32653 heartbeater.cc:511] Master 127.30.199.190:46511 requested a full tablet report, sending...
I20260620 23:03:54.931253 32524 ts_manager.cc:194] Registered new tserver with Master: 9edaf0e9491c4832bf67dbde3c14ce41 (127.30.199.129:40939)
I20260620 23:03:54.931449 32665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.931655 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.931708 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-1-root
uuid: "365b663cc5144a3c95e759f2f1c1183a"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.931758 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:54.931977 32524 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52120
I20260620 23:03:54.952827 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:54.953065 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:54.953204 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:54.953449 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:54.953490 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.953537 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:54.953565 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.956781 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.130:43647
I20260620 23:03:54.956863 32728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.130:43647 every 8 connection(s)
I20260620 23:03:54.957250 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:54.958751 32732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.958798 32733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:54.958884 32735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:54.959631 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:54.959808 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:54.959856 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:54.959877 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996634959877 us; error 0 us; skew 500 ppm
I20260620 23:03:54.960659 31518 webserver.cc:460] Webserver started at http://127.30.199.131:35697/ using document root <none> and password file <none>
I20260620 23:03:54.960753 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:54.960803 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:54.960855 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:54.961196 32729 heartbeater.cc:347] Connected to a master server at 127.30.199.190:46511
I20260620 23:03:54.961266 32729 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:54.961210 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-2-root/instance:
uuid: "d2da39cdbe30460bb489bac349354a2e"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.961354 32729 heartbeater.cc:511] Master 127.30.199.190:46511 requested a full tablet report, sending...
I20260620 23:03:54.961604 32524 ts_manager.cc:194] Registered new tserver with Master: 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130:43647)
I20260620 23:03:54.962102 32524 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52136
I20260620 23:03:54.962450 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260620 23:03:54.963023 32740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.963162 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:54.963229 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-2-root
uuid: "d2da39cdbe30460bb489bac349354a2e"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:54.963284 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:54.989626 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:54.989931 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:54.990128 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:54.990362 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:54.990409 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.990451 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:54.990479 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:54.993989 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.131:46217
I20260620 23:03:54.994107   335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.131:46217 every 8 connection(s)
I20260620 23:03:54.997751   336 heartbeater.cc:347] Connected to a master server at 127.30.199.190:46511
I20260620 23:03:54.997818   336 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:54.997911   336 heartbeater.cc:511] Master 127.30.199.190:46511 requested a full tablet report, sending...
I20260620 23:03:54.998144 32524 ts_manager.cc:194] Registered new tserver with Master: d2da39cdbe30460bb489bac349354a2e (127.30.199.131:46217)
I20260620 23:03:54.998514 32524 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52150
I20260620 23:03:54.998688 31518 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.004474656s
I20260620 23:03:55.007314 31518 test_util.cc:268] Using random seed: 1818995022
I20260620 23:03:55.012816 32524 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52172:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260620 23:03:55.013010 32524 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260620 23:03:55.018939   300 tablet_service.cc:1467] Processing CreateTablet for tablet ac8242e348ce4474a015bf4917af2202 (DEFAULT_TABLE table=test-workload [id=0101ac195272470a9bc0407757ec0809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:55.018997 32617 tablet_service.cc:1467] Processing CreateTablet for tablet ac8242e348ce4474a015bf4917af2202 (DEFAULT_TABLE table=test-workload [id=0101ac195272470a9bc0407757ec0809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:55.019140   300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8242e348ce4474a015bf4917af2202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:55.019165 32617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8242e348ce4474a015bf4917af2202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:55.020227 32693 tablet_service.cc:1467] Processing CreateTablet for tablet ac8242e348ce4474a015bf4917af2202 (DEFAULT_TABLE table=test-workload [id=0101ac195272470a9bc0407757ec0809]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:55.020332 32693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac8242e348ce4474a015bf4917af2202. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:55.020856   357 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Bootstrap starting.
I20260620 23:03:55.021001   358 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: Bootstrap starting.
I20260620 23:03:55.021430   357 tablet_bootstrap.cc:654] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:55.021508   358 tablet_bootstrap.cc:654] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:55.021755   359 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: Bootstrap starting.
I20260620 23:03:55.022105   358 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: No bootstrap required, opened a new log
I20260620 23:03:55.022149   358 ts_tablet_manager.cc:1397] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:55.022181   359 tablet_bootstrap.cc:654] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:55.022315   358 raft_consensus.cc:348] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.022385   358 raft_consensus.cc:374] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:55.022399   358 raft_consensus.cc:729] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2da39cdbe30460bb489bac349354a2e, State: Initialized, Role: FOLLOWER
I20260620 23:03:55.022472   358 consensus_queue.cc:260] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.022655   358 ts_tablet_manager.cc:1428] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:55.022675   336 heartbeater.cc:503] Master 127.30.199.190:46511 was elected leader, sending a full tablet report...
I20260620 23:03:55.022743   357 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: No bootstrap required, opened a new log
I20260620 23:03:55.022790   357 ts_tablet_manager.cc:1397] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260620 23:03:55.022943   357 raft_consensus.cc:348] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.023054   357 raft_consensus.cc:374] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:55.023077   357 raft_consensus.cc:729] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edaf0e9491c4832bf67dbde3c14ce41, State: Initialized, Role: FOLLOWER
I20260620 23:03:55.023152   357 consensus_queue.cc:260] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.023315   357 ts_tablet_manager.cc:1428] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:55.023350 32653 heartbeater.cc:503] Master 127.30.199.190:46511 was elected leader, sending a full tablet report...
I20260620 23:03:55.023517   359 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: No bootstrap required, opened a new log
I20260620 23:03:55.023567   359 ts_tablet_manager.cc:1397] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260620 23:03:55.023729   359 raft_consensus.cc:348] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.023808   359 raft_consensus.cc:374] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:55.023823   359 raft_consensus.cc:729] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 365b663cc5144a3c95e759f2f1c1183a, State: Initialized, Role: FOLLOWER
I20260620 23:03:55.023887   359 consensus_queue.cc:260] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.024042   359 ts_tablet_manager.cc:1428] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:55.024080 32729 heartbeater.cc:503] Master 127.30.199.190:46511 was elected leader, sending a full tablet report...
I20260620 23:03:55.075917   363 raft_consensus.cc:482] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260620 23:03:55.076016   363 raft_consensus.cc:504] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.076197   363 leader_election.cc:288] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edaf0e9491c4832bf67dbde3c14ce41 (127.30.199.129:40939), 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130:43647)
I20260620 23:03:55.079344 32627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8242e348ce4474a015bf4917af2202" candidate_uuid: "d2da39cdbe30460bb489bac349354a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" is_pre_election: true
I20260620 23:03:55.079389 32703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8242e348ce4474a015bf4917af2202" candidate_uuid: "d2da39cdbe30460bb489bac349354a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365b663cc5144a3c95e759f2f1c1183a" is_pre_election: true
I20260620 23:03:55.079501 32627 raft_consensus.cc:2454] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2da39cdbe30460bb489bac349354a2e in term 0.
I20260620 23:03:55.079504 32703 raft_consensus.cc:2454] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2da39cdbe30460bb489bac349354a2e in term 0.
I20260620 23:03:55.079691 32744 leader_election.cc:302] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 365b663cc5144a3c95e759f2f1c1183a, d2da39cdbe30460bb489bac349354a2e; no voters: 
I20260620 23:03:55.079818   363 raft_consensus.cc:2781] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260620 23:03:55.079866   363 raft_consensus.cc:482] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260620 23:03:55.079897   363 raft_consensus.cc:3037] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:55.080590   363 raft_consensus.cc:504] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.080729   363 leader_election.cc:288] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [CANDIDATE]: Term 1 election: Requested vote from peers 9edaf0e9491c4832bf67dbde3c14ce41 (127.30.199.129:40939), 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130:43647)
I20260620 23:03:55.080901 32703 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8242e348ce4474a015bf4917af2202" candidate_uuid: "d2da39cdbe30460bb489bac349354a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "365b663cc5144a3c95e759f2f1c1183a"
I20260620 23:03:55.080901 32627 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac8242e348ce4474a015bf4917af2202" candidate_uuid: "d2da39cdbe30460bb489bac349354a2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edaf0e9491c4832bf67dbde3c14ce41"
I20260620 23:03:55.081003 32703 raft_consensus.cc:3037] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:55.081010 32627 raft_consensus.cc:3037] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:55.081753 32703 raft_consensus.cc:2454] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2da39cdbe30460bb489bac349354a2e in term 1.
I20260620 23:03:55.081759 32627 raft_consensus.cc:2454] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2da39cdbe30460bb489bac349354a2e in term 1.
I20260620 23:03:55.081954 32744 leader_election.cc:302] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edaf0e9491c4832bf67dbde3c14ce41, d2da39cdbe30460bb489bac349354a2e; no voters: 
I20260620 23:03:55.082038   363 raft_consensus.cc:2781] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:55.082186   363 raft_consensus.cc:686] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Becoming Leader. State: Replica: d2da39cdbe30460bb489bac349354a2e, State: Running, Role: LEADER
I20260620 23:03:55.082230   363 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.082820 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: term changed from 0 to 1, leader changed from <none> to d2da39cdbe30460bb489bac349354a2e (127.30.199.131). New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.093345 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:55.093369 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260620 23:03:55.093621   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:55.093745   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260620 23:03:55.115298   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.115813 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260620 23:03:55.115866 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20260620 23:03:55.116088   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260620 23:03:55.116264   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260620 23:03:55.116951   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.117115 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.117126 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index -1 to 16, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.118234   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.118404 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a reported cstate change: config changed from index -1 to 16, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.118609 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260620 23:03:55.118605 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260620 23:03:55.118872   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260620 23:03:55.118949   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260620 23:03:55.119194 32522 catalog_manager.cc:5173] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 16: no extra replica candidate found for tablet ac8242e348ce4474a015bf4917af2202 (table test-workload [id=0101ac195272470a9bc0407757ec0809]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260620 23:03:55.119477   367 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.119565 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.119673 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index 16 to 17, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.120534 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 16 to 17, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:55.120852   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.121243 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260620 23:03:55.121243 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260620 23:03:55.121479   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:55.121585   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:55.122195   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.122318 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.123195   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.123203 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 17 to 18, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.123813 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260620 23:03:55.123833 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260620 23:03:55.123906 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.124053   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260620 23:03:55.124375   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260620 23:03:55.124853   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.125026 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.125300 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.126004 32522 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 18 to 19, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:55.126202   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.126657 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260620 23:03:55.126763 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260620 23:03:55.126879   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:55.126992   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260620 23:03:55.127499   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.127597 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.127605 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.128541 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a reported cstate change: config changed from index 19 to 20, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.128664   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.129083 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260620 23:03:55.129205 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260620 23:03:55.129343   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:55.129434   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260620 23:03:55.130033   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.130292 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.131198 32522 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 20 to 21, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:55.131299   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.131300 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.131827 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260620 23:03:55.132021   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260620 23:03:55.132481 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260620 23:03:55.132717   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260620 23:03:55.133261   367 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.133383 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.134244 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 21 to 22, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.134352   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.134246 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.134717 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260620 23:03:55.134976   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260620 23:03:55.135387 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260620 23:03:55.135687   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260620 23:03:55.135658   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.135744 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.136633 32522 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 22 to 23, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.136775 32702 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.136837   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.137204 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260620 23:03:55.137357   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:55.137940 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260620 23:03:55.138059   367 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.138109   363 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260620 23:03:55.138985 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 23 to 24, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.139057 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.139107   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.139504 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.139858 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260620 23:03:55.140148   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260620 23:03:55.140543 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260620 23:03:55.140956   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260620 23:03:55.140926   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.141042 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.141245 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.142086   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.142261 32522 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 24 to 25, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.142622 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260620 23:03:55.142635 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260620 23:03:55.142845   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:55.143042   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260620 23:03:55.143474   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.143565 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.144476 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 25 to 26, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.144531   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.144536 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.145085 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260620 23:03:55.145308 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260620 23:03:55.145267   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:55.145653   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:55.146019   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.146832 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.146883 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 26 to 27, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.146981   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.147744 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260620 23:03:55.147759 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260620 23:03:55.147971   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260620 23:03:55.148038   367 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 26, Time since last communication: 0.000s
I20260620 23:03:55.148341 32702 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.148672   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.148818 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.149638 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 27 to 28, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.150161 32702 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.150375   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.150803 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260620 23:03:55.150978   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260620 23:03:55.151042 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260620 23:03:55.151094 32510 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 22: aborting the task: latest config opid_index 28; task opid_index 22
I20260620 23:03:55.151324   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260620 23:03:55.151443   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.151578 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.152382 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 28 to 29, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.152458 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.152582   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.153396 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260620 23:03:55.153396 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260620 23:03:55.153584   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260620 23:03:55.153640   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260620 23:03:55.154189   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.154269 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.154346 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.155265 32524 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a reported cstate change: config changed from index 29 to 30, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.155515   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.155884 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260620 23:03:55.156020 32626 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260620 23:03:55.156029   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260620 23:03:55.156088 32508 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 18: aborting the task: latest config opid_index 30; task opid_index 18
I20260620 23:03:55.156292   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260620 23:03:55.156605   392 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.157423 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.157473 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 30 to 31, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:55.157572   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.157843 32626 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.158260 32702 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260620 23:03:55.158517   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260620 23:03:55.158737 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260620 23:03:55.158970   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260620 23:03:55.159521   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.159655 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.160506 32702 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.160540   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.160521 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 31 to 32, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: UNKNOWN } } }
I20260620 23:03:55.161235 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260620 23:03:55.161375 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260620 23:03:55.161643   392 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260620 23:03:55.161736   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260620 23:03:55.162374   363 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.162461 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.162549 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.163398 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a reported cstate change: config changed from index 32 to 33, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
W20260620 23:03:55.163604   367 consensus_queue.cc:1159] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "365b663cc5144a3c95e759f2f1c1183a" responder_term: 1 status { last_received { term: 1 index: 33 } last_committed_idx: 33 last_received_current_leader { term: 1 index: 33 } }
I20260620 23:03:55.163770   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.164162 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260620 23:03:55.164175 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260620 23:03:55.164462   393 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260620 23:03:55.164592   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260620 23:03:55.165210   387 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.166038 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.166062 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.166076 32522 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e reported cstate change: config changed from index 33 to 34, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: NON_VOTER last_known_addr { host: "127.30.199.130" port: 43647 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:55.166363   310 consensus_queue.cc:237] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:55.166699 32511 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 20: aborting the task: latest config opid_index 34; task opid_index 20
I20260620 23:03:55.166811 32508 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 16: aborting the task: latest config opid_index 34; task opid_index 16
I20260620 23:03:55.167104 32627 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260620 23:03:55.167186 32703 raft_consensus.cc:1261] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 LEARNER]: Refusing update from remote peer d2da39cdbe30460bb489bac349354a2e: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260620 23:03:55.167243   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260620 23:03:55.167343   387 consensus_queue.cc:1035] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260620 23:03:55.167790   392 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.167917 32627 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.168700 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.168808 32703 raft_consensus.cc:2932] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.168857 32521 catalog_manager.cc:5495] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 reported cstate change: config changed from index 34 to 35, 365b663cc5144a3c95e759f2f1c1183a (127.30.199.130) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "d2da39cdbe30460bb489bac349354a2e" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } } }
I20260620 23:03:55.169945 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.172161 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.176370 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.181087 32510 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 30: aborting the task: latest config opid_index 35; task opid_index 30
I20260620 23:03:55.182051 32508 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 26: aborting the task: latest config opid_index 35; task opid_index 26
I20260620 23:03:55.184541 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.200774 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.209316 32509 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 28: aborting the task: latest config opid_index 35; task opid_index 28
I20260620 23:03:55.221824 32509 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 32: aborting the task: latest config opid_index 35; task opid_index 32
I20260620 23:03:55.229172 32511 catalog_manager.cc:5042] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ac8242e348ce4474a015bf4917af2202 with cas_config_opid_index 34: aborting the task: latest config opid_index 35; task opid_index 34
I20260620 23:03:55.233058 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.297268 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.425566 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.681824 31518 timestamp_advancement-itest.cc:261] GCing logs...
I20260620 23:03:55.681948 31518 log_reader.cc:386] T ac8242e348ce4474a015bf4917af2202: removed 1 log segments from log reader
I20260620 23:03:55.681965 31518 log.cc:1076] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Deleting log segment in path: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root/wals/ac8242e348ce4474a015bf4917af2202/wal-000000001 (ops 1-15)
I20260620 23:03:55.682690 31518 timestamp_advancement-itest.cc:268] Shutting down cluster...
I20260620 23:03:55.682752 31518 master.cc:537] Master@127.30.199.190:46511 shutting down...
I20260620 23:03:55.837728 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:55.837862 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:55.837903 31518 tablet_replica.cc:330] T 00000000000000000000000000000000 P 66bc760b209a455384794e6852803211: stopping tablet replica
I20260620 23:03:55.850158 31518 master.cc:552] Master@127.30.199.190:46511 shutdown complete.
I20260620 23:03:55.851678 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:55.926980 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:55.927136 31518 tablet_replica.cc:330] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: stopping tablet replica
I20260620 23:03:55.927202 31518 raft_consensus.cc:2229] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:55.927277 31518 raft_consensus.cc:2258] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:55.939266 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:55.940598 31518 tablet_server.cc:178] TabletServer@127.30.199.130:0 shutting down...
I20260620 23:03:55.958043 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:55.958207 31518 tablet_replica.cc:330] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a: stopping tablet replica
I20260620 23:03:55.958276 31518 raft_consensus.cc:2229] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:55.958441 31518 raft_consensus.cc:2258] T ac8242e348ce4474a015bf4917af2202 P 365b663cc5144a3c95e759f2f1c1183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:55.970484 31518 tablet_server.cc:194] TabletServer@127.30.199.130:0 shutdown complete.
I20260620 23:03:55.971601 31518 tablet_server.cc:178] TabletServer@127.30.199.131:0 shutting down...
I20260620 23:03:55.995209 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:55.995391 31518 tablet_replica.cc:330] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e: stopping tablet replica
I20260620 23:03:55.995519 31518 raft_consensus.cc:2229] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:55.995630 31518 raft_consensus.cc:2258] T ac8242e348ce4474a015bf4917af2202 P d2da39cdbe30460bb489bac349354a2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.007596 31518 tablet_server.cc:194] TabletServer@127.30.199.131:0 shutdown complete.
I20260620 23:03:56.008605 31518 timestamp_advancement-itest.cc:276] Restarting single tablet server...
I20260620 23:03:56.008762 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:56.010200   394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.010258   395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.010205   397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.010381 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:56.010579 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.010614 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.010627 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636010627 us; error 0 us; skew 500 ppm
I20260620 23:03:56.011324 31518 webserver.cc:460] Webserver started at http://127.30.199.129:36997/ using document root <none> and password file <none>
I20260620 23:03:56.011425 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.011476 31518 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 23:03:56.012269 31518 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:56.013495   404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.013690 31518 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:56.013741 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "9edaf0e9491c4832bf67dbde3c14ce41"
format_stamp: "Formatted at 2026-06-20 23:03:54 on dist-test-slave-z4c6"
I20260620 23:03:56.013816 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5269
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.020385 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.020578 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.020737 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:56.021006   411 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260620 23:03:56.021566 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 23:03:56.021610 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:56.021632 31518 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260620 23:03:56.022043 31518 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 23:03:56.022073 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.022135   411 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Bootstrap starting.
I20260620 23:03:56.024113   411 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 23:03:56.024389   411 tablet_bootstrap.cc:492] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Bootstrap complete.
I20260620 23:03:56.024504   411 ts_tablet_manager.cc:1397] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260620 23:03:56.024621   411 raft_consensus.cc:348] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:56.024722   411 raft_consensus.cc:729] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edaf0e9491c4832bf67dbde3c14ce41, State: Initialized, Role: FOLLOWER
I20260620 23:03:56.024811   411 consensus_queue.cc:260] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 35, Last appended: 1.35, Last appended by leader: 35, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "9edaf0e9491c4832bf67dbde3c14ce41" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 40939 } } peers { permanent_uuid: "d2da39cdbe30460bb489bac349354a2e" member_type: VOTER last_known_addr { host: "127.30.199.131" port: 46217 } } peers { permanent_uuid: "365b663cc5144a3c95e759f2f1c1183a" member_type: VOTER last_known_addr { host: "127.30.199.130" port: 43647 } }
I20260620 23:03:56.024976   411 ts_tablet_manager.cc:1428] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260620 23:03:56.025604 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:40939
I20260620 23:03:56.027984   470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:40939 every 8 connection(s)
W20260620 23:03:56.028900   471 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260620 23:03:56.034503   424 tablet_service.cc:2908] Rejecting scan request for tablet ac8242e348ce4474a015bf4917af2202: Uninitialized: clean time has not yet been initialized
I20260620 23:03:56.034803 31518 timestamp_advancement-itest.cc:441] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260620 23:03:56.035157 31518 tablet_server.cc:178] TabletServer@127.30.199.129:40939 shutting down...
I20260620 23:03:56.278656 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:56.278959 31518 tablet_replica.cc:330] stopping tablet replica
I20260620 23:03:56.279053 31518 raft_consensus.cc:2229] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260620 23:03:56.279122 31518 raft_consensus.cc:2258] T ac8242e348ce4474a015bf4917af2202 P 9edaf0e9491c4832bf67dbde3c14ce41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.291260 31518 tablet_server.cc:194] TabletServer@127.30.199.129:40939 shutdown complete.
[       OK ] TimestampAdvancementITest.Kudu2463Test (1483 ms)
[ RUN      ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260620 23:03:56.295939 31518 timestamp_advancement-itest.cc:454] Running with 1 replicas
I20260620 23:03:56.296177 31518 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.199.190:34903
I20260620 23:03:56.296312 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:56.297711   476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.297752   477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.297758   479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.297888 31518 server_base.cc:1034] running on GCE node
I20260620 23:03:56.298103 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.298156 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.298177 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636298177 us; error 0 us; skew 500 ppm
I20260620 23:03:56.298928 31518 webserver.cc:460] Webserver started at http://127.30.199.190:46705/ using document root <none> and password file <none>
I20260620 23:03:56.299032 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.299095 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:56.299144 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:56.299418 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root/instance:
uuid: "af55b339183f4c2daddf014398e35e75"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.300405 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260620 23:03:56.300889   484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.301049 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.301115 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
uuid: "af55b339183f4c2daddf014398e35e75"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.301167 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.305469 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.305671 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.308343 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.190:34903
I20260620 23:03:56.308972   536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.190:34903 every 8 connection(s)
I20260620 23:03:56.309069   537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:56.310058   537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Bootstrap starting.
I20260620 23:03:56.310300   537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:56.310791   537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: No bootstrap required, opened a new log
I20260620 23:03:56.310889   537 raft_consensus.cc:348] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.310940   537 raft_consensus.cc:374] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:56.310953   537 raft_consensus.cc:729] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55b339183f4c2daddf014398e35e75, State: Initialized, Role: FOLLOWER
I20260620 23:03:56.311015   537 consensus_queue.cc:260] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.311060   537 raft_consensus.cc:388] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:56.311079   537 raft_consensus.cc:482] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:56.311110   537 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:56.311623   537 raft_consensus.cc:504] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.311676   537 leader_election.cc:302] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af55b339183f4c2daddf014398e35e75; no voters: 
I20260620 23:03:56.311749   537 leader_election.cc:288] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 23:03:56.311795   540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:56.311914   537 sys_catalog.cc:564] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 23:03:56.311946   540 raft_consensus.cc:686] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 LEADER]: Becoming Leader. State: Replica: af55b339183f4c2daddf014398e35e75, State: Running, Role: LEADER
I20260620 23:03:56.311995   540 consensus_queue.cc:237] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.312216   542 sys_catalog.cc:455] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af55b339183f4c2daddf014398e35e75. Latest consensus state: current_term: 1 leader_uuid: "af55b339183f4c2daddf014398e35e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER } }
I20260620 23:03:56.312227   541 sys_catalog.cc:455] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af55b339183f4c2daddf014398e35e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER } }
I20260620 23:03:56.312304   542 sys_catalog.cc:458] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:56.312312   541 sys_catalog.cc:458] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:56.312467   546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 23:03:56.312618   546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 23:03:56.313143 31518 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 23:03:56.313210   546 catalog_manager.cc:1347] Generated new cluster ID: de0c75220199438a9695859b6451e7eb
I20260620 23:03:56.313259   546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 23:03:56.332916   546 catalog_manager.cc:1370] Generated new certificate authority record
I20260620 23:03:56.333464   546 catalog_manager.cc:1504] Loading token signing keys...
I20260620 23:03:56.344425   546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Generated new TSK 0
I20260620 23:03:56.344565   546 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 23:03:56.348763 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:56.350358   559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.350456   561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.350545 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:56.350353   558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.350760 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.350823 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.350852 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636350850 us; error 0 us; skew 500 ppm
I20260620 23:03:56.351666 31518 webserver.cc:460] Webserver started at http://127.30.199.129:35595/ using document root <none> and password file <none>
I20260620 23:03:56.351794 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.351879 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:56.351943 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:56.352339 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root/instance:
uuid: "e6f1c32760f14135b795872d0ded2eca"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.353483 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260620 23:03:56.354074   566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.354230 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:56.354300 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "e6f1c32760f14135b795872d0ded2eca"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.354384 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.379017 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.379312 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.379563 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:56.379832 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:56.379891 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.379933 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:56.379971 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.383589 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:39541
I20260620 23:03:56.383636   629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:39541 every 8 connection(s)
I20260620 23:03:56.387876   630 heartbeater.cc:347] Connected to a master server at 127.30.199.190:34903
I20260620 23:03:56.387938   630 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:56.388001   630 heartbeater.cc:511] Master 127.30.199.190:34903 requested a full tablet report, sending...
I20260620 23:03:56.388473   501 ts_manager.cc:194] Registered new tserver with Master: e6f1c32760f14135b795872d0ded2eca (127.30.199.129:39541)
I20260620 23:03:56.388978   501 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59258
I20260620 23:03:56.389374 31518 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005530034s
I20260620 23:03:56.398348 31518 test_util.cc:268] Using random seed: 1820386057
I20260620 23:03:56.404589   501 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59278:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260620 23:03:56.410123   594 tablet_service.cc:1467] Processing CreateTablet for tablet 397a88e44e1d4bc1a328976f9de1815b (DEFAULT_TABLE table=test-workload [id=3474392bc71a4fcdab89374c48366ec4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260620 23:03:56.410287   594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 397a88e44e1d4bc1a328976f9de1815b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260620 23:03:56.411808   648 tablet_bootstrap.cc:492] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Bootstrap starting.
I20260620 23:03:56.412361   648 tablet_bootstrap.cc:654] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Neither blocks nor log segments found. Creating new log.
I20260620 23:03:56.413071   648 tablet_bootstrap.cc:492] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: No bootstrap required, opened a new log
I20260620 23:03:56.413154   648 ts_tablet_manager.cc:1397] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260620 23:03:56.413296   648 raft_consensus.cc:348] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.413393   648 raft_consensus.cc:374] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260620 23:03:56.413460   648 raft_consensus.cc:729] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f1c32760f14135b795872d0ded2eca, State: Initialized, Role: FOLLOWER
I20260620 23:03:56.413527   648 consensus_queue.cc:260] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.413584   648 raft_consensus.cc:388] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:56.413619   648 raft_consensus.cc:482] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:56.413656   648 raft_consensus.cc:3037] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 0 FOLLOWER]: Advancing to term 1
I20260620 23:03:56.414305   648 raft_consensus.cc:504] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.414427   648 leader_election.cc:302] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f1c32760f14135b795872d0ded2eca; no voters: 
I20260620 23:03:56.414587   648 leader_election.cc:288] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260620 23:03:56.414698   650 raft_consensus.cc:2781] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Leader election won for term 1
I20260620 23:03:56.414775   648 ts_tablet_manager.cc:1428] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260620 23:03:56.414817   630 heartbeater.cc:503] Master 127.30.199.190:34903 was elected leader, sending a full tablet report...
I20260620 23:03:56.414916   650 raft_consensus.cc:686] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 LEADER]: Becoming Leader. State: Replica: e6f1c32760f14135b795872d0ded2eca, State: Running, Role: LEADER
I20260620 23:03:56.414979   650 consensus_queue.cc:237] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.415452   501 catalog_manager.cc:5495] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca reported cstate change: term changed from 0 to 1, leader changed from <none> to e6f1c32760f14135b795872d0ded2eca (127.30.199.129). New cstate: current_term: 1 leader_uuid: "e6f1c32760f14135b795872d0ded2eca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:56.419477 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:56.422446 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:56.422689 31518 tablet_replica.cc:330] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: stopping tablet replica
I20260620 23:03:56.422747 31518 raft_consensus.cc:2229] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:56.422783 31518 raft_consensus.cc:2258] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.424629 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:56.425700 31518 master.cc:537] Master@127.30.199.190:34903 shutting down...
I20260620 23:03:56.428239 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 LEADER]: Raft consensus shutting down.
I20260620 23:03:56.428305 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.428375 31518 tablet_replica.cc:330] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: stopping tablet replica
I20260620 23:03:56.440729 31518 master.cc:552] Master@127.30.199.190:34903 shutdown complete.
I20260620 23:03:56.443189 31518 timestamp_advancement-itest.cc:454] Running with 3 replicas
I20260620 23:03:56.443403 31518 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.30.199.190:38473
I20260620 23:03:56.443547 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:56.445052   658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.445062   656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.445078 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:56.445045   655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.445369 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.445416 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.445438 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636445437 us; error 0 us; skew 500 ppm
I20260620 23:03:56.446084 31518 webserver.cc:460] Webserver started at http://127.30.199.190:45595/ using document root <none> and password file <none>
I20260620 23:03:56.446204 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.446260 31518 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 23:03:56.446811 31518 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.447284   663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.447441 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.447499 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
uuid: "af55b339183f4c2daddf014398e35e75"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.447561 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.460201 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.460445 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.463256 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.190:38473
I20260620 23:03:56.464275   715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.190:38473 every 8 connection(s)
I20260620 23:03:56.464944   716 sys_catalog.cc:263] Verifying existing consensus state
I20260620 23:03:56.465400   716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Bootstrap starting.
I20260620 23:03:56.467005   716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 23:03:56.467283   716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Bootstrap complete.
I20260620 23:03:56.467558   716 raft_consensus.cc:348] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.467633   716 raft_consensus.cc:729] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af55b339183f4c2daddf014398e35e75, State: Initialized, Role: FOLLOWER
I20260620 23:03:56.467687   716 consensus_queue.cc:260] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.467727   716 raft_consensus.cc:388] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:56.467764   716 raft_consensus.cc:482] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:56.467796   716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:56.468418   716 raft_consensus.cc:504] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.468500   716 leader_election.cc:302] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af55b339183f4c2daddf014398e35e75; no voters: 
I20260620 23:03:56.468611   716 leader_election.cc:288] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260620 23:03:56.468676   719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 2 FOLLOWER]: Leader election won for term 2
I20260620 23:03:56.468784   716 sys_catalog.cc:564] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: configured and running, proceeding with master startup.
I20260620 23:03:56.468860   719 raft_consensus.cc:686] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 2 LEADER]: Becoming Leader. State: Replica: af55b339183f4c2daddf014398e35e75, State: Running, Role: LEADER
I20260620 23:03:56.468914   719 consensus_queue.cc:237] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER }
I20260620 23:03:56.469097   720 sys_catalog.cc:455] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "af55b339183f4c2daddf014398e35e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER } }
I20260620 23:03:56.469202   720 sys_catalog.cc:458] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:56.469398   726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260620 23:03:56.469379   721 sys_catalog.cc:455] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af55b339183f4c2daddf014398e35e75. Latest consensus state: current_term: 2 leader_uuid: "af55b339183f4c2daddf014398e35e75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af55b339183f4c2daddf014398e35e75" member_type: VOTER } }
I20260620 23:03:56.469456   721 sys_catalog.cc:458] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [sys.catalog]: This master's current role is: LEADER
I20260620 23:03:56.469671   726 catalog_manager.cc:669] Loaded metadata for table test-workload [id=3474392bc71a4fcdab89374c48366ec4]
I20260620 23:03:56.469837   726 tablet_loader.cc:96] loaded metadata for tablet 397a88e44e1d4bc1a328976f9de1815b (table test-workload [id=3474392bc71a4fcdab89374c48366ec4])
I20260620 23:03:56.469892   726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260620 23:03:56.469955   726 catalog_manager.cc:1259] Loaded cluster ID: de0c75220199438a9695859b6451e7eb
I20260620 23:03:56.469986   726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260620 23:03:56.470005 31518 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260620 23:03:56.470669   726 catalog_manager.cc:1504] Loading token signing keys...
I20260620 23:03:56.470768   726 catalog_manager.cc:5879] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75: Loaded TSK: 0
I20260620 23:03:56.470858   726 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260620 23:03:56.471297 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 23:03:56.472667 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:56.472746   737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.472673   736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.472878   739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.473016 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.473083 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.473115 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636473115 us; error 0 us; skew 500 ppm
I20260620 23:03:56.473903 31518 webserver.cc:460] Webserver started at http://127.30.199.129:33247/ using document root <none> and password file <none>
I20260620 23:03:56.474022 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.474067 31518 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260620 23:03:56.474630 31518 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.475181   744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.475348 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.475416 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
uuid: "e6f1c32760f14135b795872d0ded2eca"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.475476 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.489614 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.489856 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.490046 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:56.490968 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260620 23:03:56.491030 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260620 23:03:56.491492 31518 ts_tablet_manager.cc:610] Registered 1 tablets
I20260620 23:03:56.491549 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.491612   751 tablet_bootstrap.cc:492] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Bootstrap starting.
I20260620 23:03:56.493240   751 tablet_bootstrap.cc:492] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260620 23:03:56.493541   751 tablet_bootstrap.cc:492] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Bootstrap complete.
I20260620 23:03:56.493667   751 ts_tablet_manager.cc:1397] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260620 23:03:56.493822   751 raft_consensus.cc:348] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.493940   751 raft_consensus.cc:729] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6f1c32760f14135b795872d0ded2eca, State: Initialized, Role: FOLLOWER
I20260620 23:03:56.494009   751 consensus_queue.cc:260] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.494073   751 raft_consensus.cc:388] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260620 23:03:56.494109   751 raft_consensus.cc:482] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260620 23:03:56.494140   751 raft_consensus.cc:3037] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 1 FOLLOWER]: Advancing to term 2
I20260620 23:03:56.494760   751 raft_consensus.cc:504] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.494869   751 leader_election.cc:302] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6f1c32760f14135b795872d0ded2eca; no voters: 
I20260620 23:03:56.495047   751 leader_election.cc:288] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260620 23:03:56.495078   805 raft_consensus.cc:2781] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 2 FOLLOWER]: Leader election won for term 2
I20260620 23:03:56.495247   751 ts_tablet_manager.cc:1428] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260620 23:03:56.495407   805 raft_consensus.cc:686] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 2 LEADER]: Becoming Leader. State: Replica: e6f1c32760f14135b795872d0ded2eca, State: Running, Role: LEADER
I20260620 23:03:56.495473 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.129:43215
I20260620 23:03:56.495519   812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.129:43215 every 8 connection(s)
I20260620 23:03:56.495467   805 consensus_queue.cc:237] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } }
I20260620 23:03:56.495939 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260620 23:03:56.497778 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:56.497838   819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.497807   818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.497962   822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.498155 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.498196 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.498226 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636498226 us; error 0 us; skew 500 ppm
I20260620 23:03:56.499094 31518 webserver.cc:460] Webserver started at http://127.30.199.130:42215/ using document root <none> and password file <none>
I20260620 23:03:56.499184 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.499238 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:56.499289 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:56.499586 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-1-root/instance:
uuid: "4f536b44709e43b89bcd861ceaa0a848"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.500780   813 heartbeater.cc:347] Connected to a master server at 127.30.199.190:38473
I20260620 23:03:56.500839   813 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:56.500866 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260620 23:03:56.500929   813 heartbeater.cc:511] Master 127.30.199.190:38473 requested a full tablet report, sending...
I20260620 23:03:56.501243   680 ts_manager.cc:194] Registered new tserver with Master: e6f1c32760f14135b795872d0ded2eca (127.30.199.129:43215)
I20260620 23:03:56.501317   680 catalog_manager.cc:5495] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "e6f1c32760f14135b795872d0ded2eca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6f1c32760f14135b795872d0ded2eca" member_type: VOTER last_known_addr { host: "127.30.199.129" port: 39541 } health_report { overall_health: HEALTHY } } }
I20260620 23:03:56.501497   827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.501641 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:56.501691 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-1-root
uuid: "4f536b44709e43b89bcd861ceaa0a848"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.501730 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.502691   680 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51478
I20260620 23:03:56.503152   813 heartbeater.cc:503] Master 127.30.199.190:38473 was elected leader, sending a full tablet report...
I20260620 23:03:56.517347 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.517601 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.517764 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:56.517992 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:56.518020 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.518044 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:56.518090 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.521775 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.130:35459
I20260620 23:03:56.521912   891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.130:35459 every 8 connection(s)
I20260620 23:03:56.522250 31518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260620 23:03:56.523779   895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260620 23:03:56.523801   896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.523993 31518 server_base.cc:1034] running on GCE node
W20260620 23:03:56.524044   898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260620 23:03:56.524237 31518 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260620 23:03:56.524279 31518 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260620 23:03:56.524297 31518 hybrid_clock.cc:648] HybridClock initialized: now 1781996636524298 us; error 0 us; skew 500 ppm
I20260620 23:03:56.525107 31518 webserver.cc:460] Webserver started at http://127.30.199.131:39449/ using document root <none> and password file <none>
I20260620 23:03:56.525223 31518 fs_manager.cc:359] Metadata directory not provided
I20260620 23:03:56.525272 31518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260620 23:03:56.525314 31518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260620 23:03:56.525640 31518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-2-root/instance:
uuid: "5c887927dbfe4f0eb0b82e9d7d146807"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.526474   892 heartbeater.cc:347] Connected to a master server at 127.30.199.190:38473
I20260620 23:03:56.526579   892 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:56.526676   892 heartbeater.cc:511] Master 127.30.199.190:38473 requested a full tablet report, sending...
I20260620 23:03:56.526824 31518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260620 23:03:56.526930   680 ts_manager.cc:194] Registered new tserver with Master: 4f536b44709e43b89bcd861ceaa0a848 (127.30.199.130:35459)
I20260620 23:03:56.527395   680 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51490
I20260620 23:03:56.527406   903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.527595 31518 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260620 23:03:56.527647 31518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-2-root
uuid: "5c887927dbfe4f0eb0b82e9d7d146807"
format_stamp: "Formatted at 2026-06-20 23:03:56 on dist-test-slave-z4c6"
I20260620 23:03:56.527724 31518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyzObit/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1781996597556624-31518-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260620 23:03:56.534268 31518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260620 23:03:56.534547 31518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260620 23:03:56.534732 31518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260620 23:03:56.534952 31518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260620 23:03:56.535000 31518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.535036 31518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260620 23:03:56.535063 31518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260620 23:03:56.538388 31518 rpc_server.cc:307] RPC server started. Bound to: 127.30.199.131:36255
I20260620 23:03:56.538534   966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.30.199.131:36255 every 8 connection(s)
I20260620 23:03:56.542280   967 heartbeater.cc:347] Connected to a master server at 127.30.199.190:38473
I20260620 23:03:56.542359   967 heartbeater.cc:464] Registering TS with master...
I20260620 23:03:56.542436   967 heartbeater.cc:511] Master 127.30.199.190:38473 requested a full tablet report, sending...
I20260620 23:03:56.542670   680 ts_manager.cc:194] Registered new tserver with Master: 5c887927dbfe4f0eb0b82e9d7d146807 (127.30.199.131:36255)
I20260620 23:03:56.543036   680 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51500
I20260620 23:03:56.543169 31518 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.00455293s
I20260620 23:03:56.552244 31518 test_util.cc:268] Using random seed: 1820539953
I20260620 23:03:56.558074 31518 test_workload.cc:401] TestWorkload: Skipping table creation because table test-workload already exists
I20260620 23:03:56.558152 31518 tablet_server.cc:178] TabletServer@127.30.199.129:0 shutting down...
I20260620 23:03:56.561807 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:56.562099 31518 tablet_replica.cc:330] stopping tablet replica
I20260620 23:03:56.562186 31518 raft_consensus.cc:2229] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 2 LEADER]: Raft consensus shutting down.
I20260620 23:03:56.562240 31518 raft_consensus.cc:2258] T 397a88e44e1d4bc1a328976f9de1815b P e6f1c32760f14135b795872d0ded2eca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.574373 31518 tablet_server.cc:194] TabletServer@127.30.199.129:0 shutdown complete.
I20260620 23:03:56.575541 31518 tablet_server.cc:178] TabletServer@127.30.199.130:0 shutting down...
I20260620 23:03:56.578349 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:56.590037 31518 tablet_server.cc:194] TabletServer@127.30.199.130:0 shutdown complete.
I20260620 23:03:56.590952 31518 tablet_server.cc:178] TabletServer@127.30.199.131:0 shutting down...
I20260620 23:03:56.594110 31518 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260620 23:03:56.605665 31518 tablet_server.cc:194] TabletServer@127.30.199.131:0 shutdown complete.
I20260620 23:03:56.606588 31518 master.cc:537] Master@127.30.199.190:38473 shutting down...
I20260620 23:03:56.609388 31518 raft_consensus.cc:2229] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 2 LEADER]: Raft consensus shutting down.
I20260620 23:03:56.609475 31518 raft_consensus.cc:2258] T 00000000000000000000000000000000 P af55b339183f4c2daddf014398e35e75 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260620 23:03:56.609551 31518 tablet_replica.cc:330] stopping tablet replica
I20260620 23:03:56.621693 31518 master.cc:552] Master@127.30.199.190:38473 shutdown complete.
[       OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (330 ms)
[----------] 4 tests from TimestampAdvancementITest (39058 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (39058 ms total)
[  PASSED  ] 3 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData

 1 FAILED TEST
I20260620 23:03:56.626550 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/catalog_manager.cc:5173: suppressed but not reported on 8 messages since previous log ~1 seconds ago
I20260620 23:03:56.626621 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260620 23:03:56.626647 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:536: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260620 23:03:56.626670 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/heartbeater.cc:644: suppressed but not reported on 6 messages since previous log ~2 seconds ago
I20260620 23:03:56.626695 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~6 seconds ago
I20260620 23:03:56.626750 31518 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 602 messages since previous log ~39 seconds ago